-- Logs begin at Wed 2022-08-24 08:14:00 UTC, end at Wed 2022-08-24 09:12:13 UTC. -- Aug 24 08:40:35.262821 dv-cinder-850321-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 08:40:35.276999 dv-cinder-850321-5-smb devstack@keystone.service[81527]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 08:40:35 2022] *** Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: nodename: dv-cinder-850321-5-smb Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: machine: x86_64 Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: clock source: unix Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: pcre jit disabled Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: detected number of CPU cores: 4 Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: current working directory: / Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: detected binary path: /usr/bin/uwsgi-core Aug 24 08:40:35.279084 dv-cinder-850321-5-smb devstack@keystone.service[81527]: your processes number limit is 47680 Aug 24 08:40:35.279671 dv-cinder-850321-5-smb devstack@keystone.service[81527]: your memory page size is 4096 bytes Aug 24 08:40:35.279671 dv-cinder-850321-5-smb devstack@keystone.service[81527]: detected max file descriptor number: 2048 Aug 24 08:40:35.279671 dv-cinder-850321-5-smb devstack@keystone.service[81527]: lock engine: pthread robust mutexes Aug 24 08:40:35.279671 dv-cinder-850321-5-smb devstack@keystone.service[81527]: thunder lock: enabled Aug 24 08:40:35.279671 dv-cinder-850321-5-smb devstack@keystone.service[81527]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 08:40:35.279671 dv-cinder-850321-5-smb devstack@keystone.service[81527]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 08:40:35.320311 dv-cinder-850321-5-smb devstack@keystone.service[81527]: Python main interpreter initialized at 0x55f45005c9c0 Aug 24 08:40:35.320311 dv-cinder-850321-5-smb devstack@keystone.service[81527]: python threads support enabled Aug 24 08:40:35.320311 dv-cinder-850321-5-smb devstack@keystone.service[81527]: your server socket listen backlog is limited to 100 connections Aug 24 08:40:35.320311 dv-cinder-850321-5-smb devstack@keystone.service[81527]: your mercy for graceful operations on workers is 90 seconds Aug 24 08:40:35.320873 dv-cinder-850321-5-smb devstack@keystone.service[81527]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 08:40:35.320873 dv-cinder-850321-5-smb devstack@keystone.service[81527]: *** Operational MODE: preforking *** Aug 24 08:40:35.321079 dv-cinder-850321-5-smb devstack@keystone.service[81527]: *** uWSGI is running in multiple interpreter mode *** Aug 24 08:40:35.321079 dv-cinder-850321-5-smb devstack@keystone.service[81527]: spawned uWSGI master process (pid: 81527) Aug 24 08:40:35.321289 dv-cinder-850321-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 08:40:35.322665 dv-cinder-850321-5-smb devstack@keystone.service[81527]: spawned uWSGI worker 1 (pid: 81541, cores: 1) Aug 24 08:40:35.322665 dv-cinder-850321-5-smb devstack@keystone.service[81527]: spawned uWSGI worker 2 (pid: 81542, cores: 1) Aug 24 08:40:35.323848 dv-cinder-850321-5-smb devstack@keystone.service[81527]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 08:40:39.617011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:40:39.617011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: from cryptography.utils import int_from_bytes Aug 24 08:40:39.617731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:40:39.617731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: from cryptography.utils import int_from_bytes Aug 24 08:40:39.623700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:40:39.623700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: from cryptography.utils import int_from_bytes Aug 24 08:40:39.624165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 08:40:39.624165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: from cryptography.utils import int_from_bytes Aug 24 08:40:39.669608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:40:39.669898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:40:39.670130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] command line args: [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:40:39.670408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:40:39.670590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ================================================================================ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:40:39.670850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] admin_token = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.671160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] config_dir = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.671354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.671539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] config_source = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.671721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] debug = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.671924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 08:40:39.673438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 08:40:39.673569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] command line args: [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 08:40:39.673688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] log_config_append = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673802 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 08:40:39.673872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] log_dir = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.673933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ================================================================================ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 08:40:39.673995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] log_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] admin_token = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] config_dir = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] config_source = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] debug = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.674900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.675926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] log_config_append = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] log_dir = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] log_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.676930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.677094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.677171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.677346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.677438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.677597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.677860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.677939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] publish_errors = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.678978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] standard_threads = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.679926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] use_journal = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] use_json = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] use_stderr = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] use_syslog = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.680955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.681037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] publish_errors = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.681204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.681282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.681448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.681532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.681668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.681743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.681898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.681977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.682135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.682212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.682372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] standard_threads = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.682451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.682606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.682689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.682850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.682928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.683030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.683115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.683208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] use_journal = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.683356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.683474 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] use_json = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.683569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] use_stderr = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.683674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.683754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] use_syslog = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.683877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.683958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 08:40:39.684075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.684178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.684316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.684440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.684595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.684706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.684849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.684950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.685942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.686930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.687886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688664 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.688888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.689041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.689121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.689289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.689382 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.689542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.689630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.689789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.690358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.690558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.690652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.690788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.690866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.691955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692799 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.692931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.693876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.694920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.695859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.696893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.697989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.698963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.699987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.700998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.701962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.702933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.703960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.704930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.705087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.705250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.705326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.705403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.705616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.706247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.706402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.706494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.706761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.706842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.external = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.707971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.password = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.708961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.709040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] auth.token = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.709215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.709293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.709456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.709534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.709836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.709931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.710198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.710277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.710477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.710588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.710718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.external = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.710955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.password = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.711969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] auth.token = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.712976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.713959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.714046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.714211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.714291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.714466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.714597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.714730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.715005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.715086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.715284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.715362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.715526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.715753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.715840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.716895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.717894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.718869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.719026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.719148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.719276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.719498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.719586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.719763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.719865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.720003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.720232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.720312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.720513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.720596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.720764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.720844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721771 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.721850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722799 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.722973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.723995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.724164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.724411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.724495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.724675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.724774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.724935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.725939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.726966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.727933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.728915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.729936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.730050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.730182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.730405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.730485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.730682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.730822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.730922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.731981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.732144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.732223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.732417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.732532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.732651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.732792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.732898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.733911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.734907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.735876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.736967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.737990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.738980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.739956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.740965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.741047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.741203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.741355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.741435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.741677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.741765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.741928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.742007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.742188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.742319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.742428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.742683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.742762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.742939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.743086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.743166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.743416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.743495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.743658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.743737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.743900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] role.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] role.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.744979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.745952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.746928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] role.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] role.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.747926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.748090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.748248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.748328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.748514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.748618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.748770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.748873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.749850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.750958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751533 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.751958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.752036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.752205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.752283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.752999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.753958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.754932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.755976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.756962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.757940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.758934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.759889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.760905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.761068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.761148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.761308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.761396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.761815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.761896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:40:39.762773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.762996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.763237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.763485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.763727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.763979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.764218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.764489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.764729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.764974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.765214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 08:40:39.765388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 08:40:39.792431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.792665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.792897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.797017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.797273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.797535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.801363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.806960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.829605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.829792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.837497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.837760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.883806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.885205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.933471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.933710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.934552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:39.934792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.092926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.093054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.093146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.093275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.093357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.116925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.117946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.118075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.118157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.118297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.118378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.118512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.129962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.130372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.142925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.143243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.143344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.143483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.143566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.143713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.143796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.143937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.144029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.144160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.144243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.144400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.144484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.144622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 08:40:40.161216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.161430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 08:40:40.161777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.161967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.162051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 08:40:40.162182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 08:40:40.162266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.162530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.162733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 08:40:40.162815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.163014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.163097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.163284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.163528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.163799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.164071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.172785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.173076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.173354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.173508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.173646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.173793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.174078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.174904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.181239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.182034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.184148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.184459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.184750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.184997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.185079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.185288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.185402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.185569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.185684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.185845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.185930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.186125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.186208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.186389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.186520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.186665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.186804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.186943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.187081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.187333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.187616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.187894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.210690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.211205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.212170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.212483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.212781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.213069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.217211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.217501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.217788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.217869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.218075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.218367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.224235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.224550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.224828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.225119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.228693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.228987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.229273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.229354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.229561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.229657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.229845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.229928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.230127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.230210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.230405 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.230489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.230695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.230775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.230976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.231251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.248504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.248771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.249232 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.249518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.253275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.254185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.256561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.256864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.257444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.257747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.261094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.262276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.264535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.265463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.267777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.268109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.268415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.268722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.268804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.269012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.269107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.269315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.269398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.269641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.269927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.270234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.285656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.285946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.286215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.286485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.286704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.286998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.287272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.287543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.293469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.294646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.295009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.295293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.296195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.296511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.297990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.298281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.298593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.298877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.299171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.299269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.300106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.300424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.300725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.301019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.311430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.311721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.312013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.312306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.312537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.312623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.312826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.312919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.313113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.313197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.313400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.313689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.313972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.314260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.328612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.329955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.331697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.333052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.334647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.335972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.336109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.337500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.337628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.337918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.338225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.339017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.339305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.339608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.344825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.346728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.346819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.348215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.349705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.350010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.350305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.350594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.351220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.351516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.351808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.352097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.358576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.358873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.359162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.360216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.360539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.360829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.366704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.366997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.367285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.367566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.367845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.368133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.368435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.368517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 08:40:40.368714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.368809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.369925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.370127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.370216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.370391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.370482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.370701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.370996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.371277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.371555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.371827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.372093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 08:40:40.405506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f45005c9c0 pid: 81542 (default app) Aug 24 08:40:40.408432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f45005c9c0 pid: 81541 (default app) Aug 24 08:40:40.409534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74c74-e6f6-4b4d-b117-5a2458fa4d13 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:40.409828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74c74-e6f6-4b4d-b117-5a2458fa4d13 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:40.410110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb74c74-e6f6-4b4d-b117-5a2458fa4d13 None None] PATH_INFO: `/v3` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:40.414284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Wed Aug 24 08:40:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:40:46.883614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f6df6-caec-4269-b7fd-09bdc0e38020 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:46.884092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f6df6-caec-4269-b7fd-09bdc0e38020 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:46.884092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f6df6-caec-4269-b7fd-09bdc0e38020 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:46.888667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:46.895661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:46.896028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:46.896207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:46.965566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: INFO dbcounter [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] Registered counter for database keystone Aug 24 08:40:46.984071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG oslo_db.sqlalchemy.engines [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:40:46.990338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writer thread running {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:40:47.169416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG passlib.handlers.bcrypt [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81542) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 08:40:47.169832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG passlib.handlers.bcrypt [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81542) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 08:40:47.224056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:47.225688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:47.352690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 08:40:47.820605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f6df6-caec-4269-b7fd-09bdc0e38020 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:47.888931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: INFO dbcounter [None req-d71f6df6-caec-4269-b7fd-09bdc0e38020 None None] Registered counter for database keystone Aug 24 08:40:47.911115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG oslo_db.sqlalchemy.engines [None req-d71f6df6-caec-4269-b7fd-09bdc0e38020 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 08:40:47.917251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writer thread running {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 08:40:48.042968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f6df6-caec-4269-b7fd-09bdc0e38020 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:48.047142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3bdcf-7357-445a-82e3-f610fe149943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:48.047759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3bdcf-7357-445a-82e3-f610fe149943 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:48.048037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3bdcf-7357-445a-82e3-f610fe149943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:48.048303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3bdcf-7357-445a-82e3-f610fe149943 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:48.056194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3bdcf-7357-445a-82e3-f610fe149943 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:48.107377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e8b3bdcf-7357-445a-82e3-f610fe149943 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 08:40:48.107721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3bdcf-7357-445a-82e3-f610fe149943 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:48.117734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 24 08:40:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:40:48.123572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:48.138553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2ecd4-f561-4308-892d-58264a68f151 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:48.142907 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db097c63-ae57-42cd-aa06-1afabe6b97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:48.143972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db097c63-ae57-42cd-aa06-1afabe6b97ac admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:48.144253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db097c63-ae57-42cd-aa06-1afabe6b97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:48.144566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db097c63-ae57-42cd-aa06-1afabe6b97ac admin admin] PATH_INFO: `/v3/projects/99f84482a9b64bcfb8dae5485dc7545f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:48.146106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db097c63-ae57-42cd-aa06-1afabe6b97ac admin admin] RBAC: Authorizing `identity:get_project(project_id=99f84482a9b64bcfb8dae5485dc7545f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:48.198760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db097c63-ae57-42cd-aa06-1afabe6b97ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 08:40:48.199101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db097c63-ae57-42cd-aa06-1afabe6b97ac admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:48.203568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Wed Aug 24 08:40:48 2022] GET /identity/v3/projects/99f84482a9b64bcfb8dae5485dc7545f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:40:50.075846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038098cd-f456-4ef2-8395-49ccdf0be443 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:50.076360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038098cd-f456-4ef2-8395-49ccdf0be443 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:50.076472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038098cd-f456-4ef2-8395-49ccdf0be443 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:50.080539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:50.086438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87c2c-78df-4c70-be55-91a5ca5f6187 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:50.086852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87c2c-78df-4c70-be55-91a5ca5f6187 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:50.087002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d87c2c-78df-4c70-be55-91a5ca5f6187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:50.107255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f2d87c2c-78df-4c70-be55-91a5ca5f6187 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:50.108828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f2d87c2c-78df-4c70-be55-91a5ca5f6187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:50.117170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 08:40:50.387850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038098cd-f456-4ef2-8395-49ccdf0be443 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:50.400134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038098cd-f456-4ef2-8395-49ccdf0be443 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:50.404234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8d918-682c-41af-84b5-51a0dbe3dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:50.404868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8d918-682c-41af-84b5-51a0dbe3dd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:50.405149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8d918-682c-41af-84b5-51a0dbe3dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:50.405422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8d918-682c-41af-84b5-51a0dbe3dd27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:50.413563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8d918-682c-41af-84b5-51a0dbe3dd27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:50.415317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8d918-682c-41af-84b5-51a0dbe3dd27 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:50.423815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Wed Aug 24 08:40:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:40:50.429112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87c2c-78df-4c70-be55-91a5ca5f6187 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:50.438067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d87c2c-78df-4c70-be55-91a5ca5f6187 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:50.442944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8378033-7e14-45fe-8247-c5fec83645fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:50.443566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378033-7e14-45fe-8247-c5fec83645fd admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:50.443850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378033-7e14-45fe-8247-c5fec83645fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:50.444126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378033-7e14-45fe-8247-c5fec83645fd admin admin] PATH_INFO: `/v3/users/683fbdc2cecc4c059e82825e29207432` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:50.445481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8378033-7e14-45fe-8247-c5fec83645fd admin admin] RBAC: Authorizing `identity:get_user(user_id=683fbdc2cecc4c059e82825e29207432)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:50.447284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8378033-7e14-45fe-8247-c5fec83645fd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:50.448823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Wed Aug 24 08:40:50 2022] GET /identity/v3/users/683fbdc2cecc4c059e82825e29207432 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:40:52.375549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f0f3b-f84e-48e8-9686-70115080ce89 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:52.376136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f0f3b-f84e-48e8-9686-70115080ce89 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:52.376136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f0f3b-f84e-48e8-9686-70115080ce89 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:52.377489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:52.382786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472a7c-6e07-4938-a003-0050484ce8d6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:52.383208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472a7c-6e07-4938-a003-0050484ce8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:52.383344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472a7c-6e07-4938-a003-0050484ce8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:52.402859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c1472a7c-6e07-4938-a003-0050484ce8d6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:52.404053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c1472a7c-6e07-4938-a003-0050484ce8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:52.462213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a4560-e35f-46a9-ba0b-3216c61ce63b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:52.462497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a4560-e35f-46a9-ba0b-3216c61ce63b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:52.462776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a4560-e35f-46a9-ba0b-3216c61ce63b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:52.464100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:40:52.469437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:52.469728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:52.470004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:52.491974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:40:52.512408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG passlib.handlers.bcrypt [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81541) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 08:40:52.512854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG passlib.handlers.bcrypt [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81541) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 08:40:52.558901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:52.560481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:52.658011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:40:52.760969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472a7c-6e07-4938-a003-0050484ce8d6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:52.785910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:52.866884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472a7c-6e07-4938-a003-0050484ce8d6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:52.900927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:52.901559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:52.901841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:52.902116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:52.913628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:40:52.922250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:40:52.923304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:40:52.924195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:40:52.929367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:52.935231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:53.015735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:53.034732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7377b5-af01-437b-bf2f-9eb7546ae983 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:53.034902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd25fd9-1ebf-4bb5-8147-0009a7290935 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:53.037582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:53.069434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:53.070053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:53.070343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:53.070624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:53.071915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:53.072808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:53.073098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:53.073371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:53.074204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:40:53.074510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:53.075935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:53.087479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:40:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:40:53.093007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:53.141706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:53.143232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:53.195306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf26e83-3953-4954-9780-104d79b08e0c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:53.222314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:53.228137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:53.229055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:53.229334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:53.229608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] PATH_INFO: `/v3/users/683fbdc2cecc4c059e82825e29207432` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:53.231132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] RBAC: Authorizing `identity:get_user(user_id=683fbdc2cecc4c059e82825e29207432)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:53.232620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:53.234360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:40:53 2022] GET /identity/v3/users/683fbdc2cecc4c059e82825e29207432 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:40:53.240257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:53.241588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 08:40:53.246840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:53.275631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:53.340062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574e15-467f-4ec2-83af-5386ef207d5e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:53.344348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f786ae9-d1ef-4024-ad4f-5e46a962c62f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:53.372779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:53.373410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:53.373691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:53.373967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:53.375091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:53.376587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:53.378494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:53.378695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:40:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:40:53.379140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:53.379421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:53.379696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:53.384500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:53.390243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:53.391726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:40:53.407040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:40:53.407981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:40:53.408812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:40:53.408812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:40:53.408812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:40:53.408812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:40:53.414629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:53.450692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:53.485130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c260f2-dc46-41d4-bfe9-ef06f40db4d9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:53.486652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:53.520348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482fde8-6fc1-4c32-a146-825fa448fb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:53.520989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fde8-6fc1-4c32-a146-825fa448fb5d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:53.521273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fde8-6fc1-4c32-a146-825fa448fb5d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:53.521548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482fde8-6fc1-4c32-a146-825fa448fb5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:53.522129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbda4c7-aab4-4ad7-9c25-a469806825ad None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:53.522280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fde8-6fc1-4c32-a146-825fa448fb5d None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.domain.id=default, user.id=683fbdc2cecc4c059e82825e29207432) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:40:53.522591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fde8-6fc1-4c32-a146-825fa448fb5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:53.524042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482fde8-6fc1-4c32-a146-825fa448fb5d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:53.532539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 24 08:40:53 2022] GET /identity/v3/role_assignments?user.id=683fbdc2cecc4c059e82825e29207432&scope.domain.id=default&role.id=759ce9628735416988d65affdc29c636 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:40:53.558588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495001c-d705-4839-91e8-fb4ca2972483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:53.559219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495001c-d705-4839-91e8-fb4ca2972483 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:53.559502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495001c-d705-4839-91e8-fb4ca2972483 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:53.559776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495001c-d705-4839-91e8-fb4ca2972483 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:53.560479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495001c-d705-4839-91e8-fb4ca2972483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:40:53.560785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495001c-d705-4839-91e8-fb4ca2972483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:53.562229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495001c-d705-4839-91e8-fb4ca2972483 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:53.581935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:40:55.562472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6076a-f264-47e0-b659-0922ba29039e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:55.563014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6076a-f264-47e0-b659-0922ba29039e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:55.563014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6076a-f264-47e0-b659-0922ba29039e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:55.564685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:55.570301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8390d-a256-4494-ab9d-5c0e143718a2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:55.570718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8390d-a256-4494-ab9d-5c0e143718a2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:55.570906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8390d-a256-4494-ab9d-5c0e143718a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:55.595898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1ea8390d-a256-4494-ab9d-5c0e143718a2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:55.597246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ea8390d-a256-4494-ab9d-5c0e143718a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:55.692187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:40:55.869269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9759a-2b1f-485b-903b-b98f0dd1ac9b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:55.869588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9759a-2b1f-485b-903b-b98f0dd1ac9b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:55.869782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9759a-2b1f-485b-903b-b98f0dd1ac9b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:55.871091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:55.876402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a683e-6e46-4519-9443-4c3b2fd3b4e6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:55.876973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a683e-6e46-4519-9443-4c3b2fd3b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:55.877447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a683e-6e46-4519-9443-4c3b2fd3b4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:55.898423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-085a683e-6e46-4519-9443-4c3b2fd3b4e6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:55.899959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-085a683e-6e46-4519-9443-4c3b2fd3b4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:55.933259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:56.007093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:40:56.082655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9759a-2b1f-485b-903b-b98f0dd1ac9b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:56.160072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa70f6-326c-4812-8e4a-c68c50842453 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.160369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa70f6-326c-4812-8e4a-c68c50842453 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.160635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa70f6-326c-4812-8e4a-c68c50842453 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.162173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 13/26] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:40:56.167332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947753c-f67e-42ae-96df-b5acd9094ebb None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.167855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947753c-f67e-42ae-96df-b5acd9094ebb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.168349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947753c-f67e-42ae-96df-b5acd9094ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.206160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4947753c-f67e-42ae-96df-b5acd9094ebb None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:56.208781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4947753c-f67e-42ae-96df-b5acd9094ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:56.246156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9759a-2b1f-485b-903b-b98f0dd1ac9b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:56.333984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:56.334633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.334918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.335193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.365448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:40:56.374723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:40:56.375648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:40:56.376441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 14/27] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:40:56.389549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:56.390961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:40:56.392476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553564-49e3-4925-a0bb-b4ddc4a0f9b8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.392977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553564-49e3-4925-a0bb-b4ddc4a0f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.394019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553564-49e3-4925-a0bb-b4ddc4a0f9b8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.395694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 15/29] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:56.400661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a35cd-6d92-4ec6-af7e-6938c21b55d5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.401202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a35cd-6d92-4ec6-af7e-6938c21b55d5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.401695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a35cd-6d92-4ec6-af7e-6938c21b55d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.433377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6b6a35cd-6d92-4ec6-af7e-6938c21b55d5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:56.434911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6b6a35cd-6d92-4ec6-af7e-6938c21b55d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:56.465050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:56.566678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 16/30] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:40:56.567678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a35cd-6d92-4ec6-af7e-6938c21b55d5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:56.587590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:56.597775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec94b0-cc35-490a-8809-ff531b783919 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:56.666265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:56.666893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.667178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.667456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.668750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:40:56.669080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:56.670631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:56.681464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 15/31] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:40:56.689583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:56.775635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a35cd-6d92-4ec6-af7e-6938c21b55d5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:56.819519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:56.821036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.821327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.821604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.843139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:56.844660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:56.852750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:40:56.872364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:40:56.873524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:40:56.874436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:40:56.874436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:40:56.874436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:40:56.877316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960685d0-0062-4852-8c64-412cd4a05244 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:56.880000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 17/32] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:40:56.881936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:56.945534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:56.946433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:56.949745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:56.950192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] PATH_INFO: `/v3/users/683fbdc2cecc4c059e82825e29207432` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:56.953009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] RBAC: Authorizing `identity:get_user(user_id=683fbdc2cecc4c059e82825e29207432)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:56.954653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:56.959622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 16/33] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:40:56 2022] GET /identity/v3/users/683fbdc2cecc4c059e82825e29207432 => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:40:56.962798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:57.002884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:57.044511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925822a7-0e4c-4bfd-a5ff-67cfc5e67651 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:57.080611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a5195-e589-4f81-b475-28e03659677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:57.081858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a5195-e589-4f81-b475-28e03659677b None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.082423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a5195-e589-4f81-b475-28e03659677b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.082423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a5195-e589-4f81-b475-28e03659677b None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.083124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a5195-e589-4f81-b475-28e03659677b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:57.084675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a5195-e589-4f81-b475-28e03659677b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:57.108201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d438755-f0db-46b9-8996-61471f14e0cb None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:57.144428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:57.145408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.145919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.146399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.147259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:40:57.147767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:57.149429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:57.171825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 17/34] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:40:57.173050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:57.192899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:57.223834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 18/35] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 08:40:56 2022] POST /identity/v3/roles => generated 219 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:40:57.232602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a5195-e589-4f81-b475-28e03659677b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:57.329631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3451c3-d1d6-45c2-93de-ff17007f357a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:57.342152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a5195-e589-4f81-b475-28e03659677b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:57.375465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:57.388129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b946f5a-002b-4aa6-8847-1e29b04ee1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:57.388812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946f5a-002b-4aa6-8847-1e29b04ee1c3 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.389095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946f5a-002b-4aa6-8847-1e29b04ee1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.389373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b946f5a-002b-4aa6-8847-1e29b04ee1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.390068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b946f5a-002b-4aa6-8847-1e29b04ee1c3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:57.391642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b946f5a-002b-4aa6-8847-1e29b04ee1c3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:57.391890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:57.392817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.393427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.394401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.396207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:57.398767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:57.401082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 18/36] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:40:57.401847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:57.411866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 08:40:57 2022] POST /identity/v3/roles => generated 225 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:40:57.413926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d720-f92f-47c9-8404-698290ca8ced None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.414429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d720-f92f-47c9-8404-698290ca8ced None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.414904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d720-f92f-47c9-8404-698290ca8ced None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.417085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 20/38] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:57.418272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d720-f92f-47c9-8404-698290ca8ced None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:57.548244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:57.564535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d720-f92f-47c9-8404-698290ca8ced None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:57.578138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bf039-3a1d-4653-bb0a-3b4f847449a5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:57.627453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa897909-ae48-471e-b78e-d9a198b96d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:57.628184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d51517-4297-41c3-acb4-bf6402aace84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:57.628612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa897909-ae48-471e-b78e-d9a198b96d4e None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.628612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa897909-ae48-471e-b78e-d9a198b96d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.628751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51517-4297-41c3-acb4-bf6402aace84 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.628818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa897909-ae48-471e-b78e-d9a198b96d4e None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.629087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51517-4297-41c3-acb4-bf6402aace84 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.629291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51517-4297-41c3-acb4-bf6402aace84 None admin] PATH_INFO: `/v3/domains/default/users/683fbdc2cecc4c059e82825e29207432/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.629528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa897909-ae48-471e-b78e-d9a198b96d4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:57.630992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa897909-ae48-471e-b78e-d9a198b96d4e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:57.631400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d51517-4297-41c3-acb4-bf6402aace84 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=683fbdc2cecc4c059e82825e29207432, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:57.634228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d51517-4297-41c3-acb4-bf6402aace84 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:57.650816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 21/39] 10.222.0.42 () {58 vars in 1361 bytes} [Wed Aug 24 08:40:57 2022] PUT /identity/v3/domains/default/users/683fbdc2cecc4c059e82825e29207432/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:40:57.652622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b8f6-efd4-4f16-b2bf-d062cd734bcd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.652916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b8f6-efd4-4f16-b2bf-d062cd734bcd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.653291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b8f6-efd4-4f16-b2bf-d062cd734bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.679240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0f71b8f6-efd4-4f16-b2bf-d062cd734bcd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:57.681049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0f71b8f6-efd4-4f16-b2bf-d062cd734bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:57.793244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 19/40] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:40:57 2022] POST /identity/v3/projects => generated 301 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:40:57.794805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49c09-b81d-4bba-8c28-23742f98a1d1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.795105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49c09-b81d-4bba-8c28-23742f98a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.795389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb49c09-b81d-4bba-8c28-23742f98a1d1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.797568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 20/41] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:57.804158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc682-eb33-48ca-a6ec-04eca534495f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:57.804344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc682-eb33-48ca-a6ec-04eca534495f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:57.804652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bc682-eb33-48ca-a6ec-04eca534495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:57.826470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2e8bc682-eb33-48ca-a6ec-04eca534495f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:57.828182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2e8bc682-eb33-48ca-a6ec-04eca534495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:57.857524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:57.886892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:40:57.912110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 21/43] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:40:58.161352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71b8f6-efd4-4f16-b2bf-d062cd734bcd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:58.187833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bc682-eb33-48ca-a6ec-04eca534495f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:58.265211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:58.277299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71b8f6-efd4-4f16-b2bf-d062cd734bcd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:58.305982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bc682-eb33-48ca-a6ec-04eca534495f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:58.311961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:58.312619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:58.312915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:58.313190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:58.313865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:58.315782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:58.332701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 08:40:58 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:40:58.349467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f57f6-5e4d-49fc-bfa0-0464ed757d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:58.350147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f57f6-5e4d-49fc-bfa0-0464ed757d9d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:58.350435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f57f6-5e4d-49fc-bfa0-0464ed757d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:58.350714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f57f6-5e4d-49fc-bfa0-0464ed757d9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:58.351925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f57f6-5e4d-49fc-bfa0-0464ed757d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:58.353620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f57f6-5e4d-49fc-bfa0-0464ed757d9d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:58.355512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 22/45] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:40:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:40:58.361594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:40:58.403093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:40:58.485857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d44d93-e4ca-4eee-a6c8-48b06be5fa9a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:40:58.523239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bf8b1-5e14-49f8-8811-3237512aa835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:40:58.524207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf8b1-5e14-49f8-8811-3237512aa835 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:58.524207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf8b1-5e14-49f8-8811-3237512aa835 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:58.524565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf8b1-5e14-49f8-8811-3237512aa835 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:58.526563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bf8b1-5e14-49f8-8811-3237512aa835 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:40:58.526563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bf8b1-5e14-49f8-8811-3237512aa835 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:40:58.555049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:40:58 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:40:59.627173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916696cb-e616-4cff-82e2-ec645be9d9e4 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:59.627727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916696cb-e616-4cff-82e2-ec645be9d9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:59.627999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916696cb-e616-4cff-82e2-ec645be9d9e4 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:59.629427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:40:59.634824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f38da-1a4a-4f88-a62c-90965219befc None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:40:59.635225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f38da-1a4a-4f88-a62c-90965219befc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:40:59.635382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f38da-1a4a-4f88-a62c-90965219befc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:40:59.653451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9f5f38da-1a4a-4f88-a62c-90965219befc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:40:59.654666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9f5f38da-1a4a-4f88-a62c-90965219befc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:40:59.718878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:40:59.985565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916696cb-e616-4cff-82e2-ec645be9d9e4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:00.083298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916696cb-e616-4cff-82e2-ec645be9d9e4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:00.115832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:00.116489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.116776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.117051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.118887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:00.128500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:00.133381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:00.134258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:00.135091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:00.140730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f38da-1a4a-4f88-a62c-90965219befc None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:00.158913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:00.240644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f38da-1a4a-4f88-a62c-90965219befc None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:00.280123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:00.281102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.281393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.281673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.282349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:00.282663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:00.284616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:00.296977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:00.303078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:00.399652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e0143-1bd2-4cf7-8515-c3f1aea920bc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:00.432926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133244-5333-46a2-b784-e5fafd20389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:00.433558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133244-5333-46a2-b784-e5fafd20389c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.433844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133244-5333-46a2-b784-e5fafd20389c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.434125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133244-5333-46a2-b784-e5fafd20389c None admin] PATH_INFO: `/v3/users/683fbdc2cecc4c059e82825e29207432` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.435249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133244-5333-46a2-b784-e5fafd20389c None admin] RBAC: Authorizing `identity:get_user(user_id=683fbdc2cecc4c059e82825e29207432)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:00.436723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133244-5333-46a2-b784-e5fafd20389c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:00.438314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 25/51] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:00 2022] GET /identity/v3/users/683fbdc2cecc4c059e82825e29207432 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:00.444045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:00.447373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee7b9-1ffa-42bd-b063-d01b18850173 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.447663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee7b9-1ffa-42bd-b063-d01b18850173 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.447946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ee7b9-1ffa-42bd-b063-d01b18850173 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.449258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 26/52] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:41:00.454058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4746-a3cd-4641-8d96-c26a1241fc41 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.454344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4746-a3cd-4641-8d96-c26a1241fc41 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.454619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d4746-a3cd-4641-8d96-c26a1241fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.472501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ba3d4746-a3cd-4641-8d96-c26a1241fc41 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:00.473692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ba3d4746-a3cd-4641-8d96-c26a1241fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:00.525514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:00.530267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:00.540931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 27/53] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:00.545114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db140171-1529-4d3e-b28e-5a90332db658 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:00.578437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:00.579085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.579371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.579646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.580817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:00.582398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:00.584142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 27/54] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:00.589870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d4746-a3cd-4641-8d96-c26a1241fc41 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:00.685390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d4746-a3cd-4641-8d96-c26a1241fc41 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:00.718077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:00.718671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.718952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.719225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.719951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.domain.id=default, user.id=683fbdc2cecc4c059e82825e29207432) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:00.720260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:00.721757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:00.727311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1322 bytes} [Wed Aug 24 08:41:00 2022] GET /identity/v3/role_assignments?user.id=683fbdc2cecc4c059e82825e29207432&scope.domain.id=default&role.id=759ce9628735416988d65affdc29c636 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:00.816604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:00.920140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dea134-53d7-431f-a806-909330941ae7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:00.954751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4711be8-87fa-4a93-b399-97d89761000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:00.955386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4711be8-87fa-4a93-b399-97d89761000a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:00.955671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4711be8-87fa-4a93-b399-97d89761000a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:00.955972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4711be8-87fa-4a93-b399-97d89761000a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:00.957175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4711be8-87fa-4a93-b399-97d89761000a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:00.958614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4711be8-87fa-4a93-b399-97d89761000a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:00.960167 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:00.965682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:01.019856 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:01.062237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b942f-e8b2-4e6f-a536-fe876770bdd5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:01.093465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b1286-8fcb-4d94-9470-c5252c4f2d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:01.094011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b1286-8fcb-4d94-9470-c5252c4f2d83 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:01.094297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b1286-8fcb-4d94-9470-c5252c4f2d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:01.094577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b1286-8fcb-4d94-9470-c5252c4f2d83 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:01.095226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b1286-8fcb-4d94-9470-c5252c4f2d83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:01.097364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b1286-8fcb-4d94-9470-c5252c4f2d83 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:01.123283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 24 08:41:00 2022] POST /identity/v3/projects => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:02.997999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f6c27-f071-469d-8aa3-f317f4052f09 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:02.998550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f6c27-f071-469d-8aa3-f317f4052f09 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:02.998550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f6c27-f071-469d-8aa3-f317f4052f09 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:02.999886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:03.005773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4d56c-f762-478e-a75a-8a5b748146cd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:03.006183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4d56c-f762-478e-a75a-8a5b748146cd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:03.006391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4d56c-f762-478e-a75a-8a5b748146cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:03.131444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a7b4d56c-f762-478e-a75a-8a5b748146cd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:03.132800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a7b4d56c-f762-478e-a75a-8a5b748146cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:03.202542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:03.469299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f6c27-f071-469d-8aa3-f317f4052f09 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:03.488185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:03.570027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f6c27-f071-469d-8aa3-f317f4052f09 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:03.604776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c28563-3c29-44fa-96b6-be1459713179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:03.605417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c28563-3c29-44fa-96b6-be1459713179 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:03.605703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c28563-3c29-44fa-96b6-be1459713179 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:03.605981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c28563-3c29-44fa-96b6-be1459713179 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:03.607109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c28563-3c29-44fa-96b6-be1459713179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:03.608592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c28563-3c29-44fa-96b6-be1459713179 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:03.610157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:03.615803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4d56c-f762-478e-a75a-8a5b748146cd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:03.654357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:03.715201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4d56c-f762-478e-a75a-8a5b748146cd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:03.750242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e45918-ee1d-4e87-9270-4df034c14dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:03.750844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45918-ee1d-4e87-9270-4df034c14dae None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:03.751151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45918-ee1d-4e87-9270-4df034c14dae None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:03.751450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45918-ee1d-4e87-9270-4df034c14dae None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:03.752170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e45918-ee1d-4e87-9270-4df034c14dae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:03.753744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e45918-ee1d-4e87-9270-4df034c14dae None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:03.781275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:41:03 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:06.795497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7c7f4-5668-489c-9327-48e2f6199f89 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:06.795994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7c7f4-5668-489c-9327-48e2f6199f89 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:06.796253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7c7f4-5668-489c-9327-48e2f6199f89 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:06.797855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:06.814010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fa9f4-b1ac-42e5-879d-b0e17518546a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:06.814951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fa9f4-b1ac-42e5-879d-b0e17518546a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:06.815528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fa9f4-b1ac-42e5-879d-b0e17518546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:06.830634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1482-036d-49b3-970d-38892ed33ba2 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:06.831400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1482-036d-49b3-970d-38892ed33ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:06.831641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e1482-036d-49b3-970d-38892ed33ba2 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:06.833142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:06.838495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-117fa9f4-b1ac-42e5-879d-b0e17518546a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:06.839828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-117fa9f4-b1ac-42e5-879d-b0e17518546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:06.849234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c1ff3-08d8-467e-82a2-f3f23a7e00c4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:06.849523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c1ff3-08d8-467e-82a2-f3f23a7e00c4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:06.849806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c1ff3-08d8-467e-82a2-f3f23a7e00c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:06.889224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8a9c1ff3-08d8-467e-82a2-f3f23a7e00c4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:06.890535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8a9c1ff3-08d8-467e-82a2-f3f23a7e00c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:06.937428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 32/64] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:06.971296 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89247bc-f362-42d5-8f8b-bc82110173c4 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:06.972155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89247bc-f362-42d5-8f8b-bc82110173c4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:06.972441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89247bc-f362-42d5-8f8b-bc82110173c4 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:06.973912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 33/65] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:41:06.978994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76da4-8b57-4af5-82be-c82de9c1ca78 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:06.979313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76da4-8b57-4af5-82be-c82de9c1ca78 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:06.979595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76da4-8b57-4af5-82be-c82de9c1ca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.008213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-26c76da4-8b57-4af5-82be-c82de9c1ca78 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:07.009536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-26c76da4-8b57-4af5-82be-c82de9c1ca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:07.044798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:07.049743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 33/66] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:07.095807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 34/67] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:07.238581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c1ff3-08d8-467e-82a2-f3f23a7e00c4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.258389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:07.329465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffeb57-57e9-4715-933d-e2dd796e4976 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.330093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffeb57-57e9-4715-933d-e2dd796e4976 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.330537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffeb57-57e9-4715-933d-e2dd796e4976 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.336480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 35/68] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:07.345940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6e69b-7ed3-4a62-a9e2-a00ec75886ed None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.346409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6e69b-7ed3-4a62-a9e2-a00ec75886ed None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.346880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6e69b-7ed3-4a62-a9e2-a00ec75886ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.349100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c1ff3-08d8-467e-82a2-f3f23a7e00c4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:07.381424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cea6e69b-7ed3-4a62-a9e2-a00ec75886ed None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:07.382634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cea6e69b-7ed3-4a62-a9e2-a00ec75886ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:07.389526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:07.390179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.390461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.390800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.402263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:07.407024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:07.407985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:07.408980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:07.411321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:07.412250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.465711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 36/70] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:07.467257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6e69b-7ed3-4a62-a9e2-a00ec75886ed None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.492931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:07.529157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b52ee-d3a5-41ca-b8a6-1881f355ab34 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:07.562639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:07.578154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:07.578900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.579530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.579891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.589520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6e69b-7ed3-4a62-a9e2-a00ec75886ed None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:07.600992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:07.607215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:07.608058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:07.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:07.609544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.645047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:07.645842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.646455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.646864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.648057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:07.648759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:07.650242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:07.665071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 37/72] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:07.666604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.739757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681ddc-53ec-4e02-b509-6273e40d9fc4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:07.774341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:07.774983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.775278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.775566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.776459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21929fff-5535-42d3-b552-fa54c15b2324 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:07.777495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:07.788039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:07.793256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:07.794157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:07.794930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:07.795560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.815674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f1554-7c83-4f68-b2eb-00d17dbc3538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:07.816289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1554-7c83-4f68-b2eb-00d17dbc3538 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.816610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1554-7c83-4f68-b2eb-00d17dbc3538 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.817316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f1554-7c83-4f68-b2eb-00d17dbc3538 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.817995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f1554-7c83-4f68-b2eb-00d17dbc3538 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:07.818308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f1554-7c83-4f68-b2eb-00d17dbc3538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:07.819696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f1554-7c83-4f68-b2eb-00d17dbc3538 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:07.827476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:07.829494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40c79f-9543-425f-aa6c-3b96fc2cdfd5 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.829494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40c79f-9543-425f-aa6c-3b96fc2cdfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.829494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40c79f-9543-425f-aa6c-3b96fc2cdfd5 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.830493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 39/75] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:07.831080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40c79f-9543-425f-aa6c-3b96fc2cdfd5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.842394 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:07.896553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b14d9-64d9-46a8-b4aa-c4403dd3e0b4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:07.929467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:07.930102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.930387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.930661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] PATH_INFO: `/v3/users/683fbdc2cecc4c059e82825e29207432` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.931738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40c79f-9543-425f-aa6c-3b96fc2cdfd5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:07.931861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] RBAC: Authorizing `identity:get_user(user_id=683fbdc2cecc4c059e82825e29207432)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:07.933288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:07.934846 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/users/683fbdc2cecc4c059e82825e29207432 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:07.939693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:07.966139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:07.966780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:07.967059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:07.967337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:07.978309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:07.983684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:07.984775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:07.985550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 40/77] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:07.986177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.006643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.045610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e70f21-f9df-4b07-8ca9-5b58a7e2e262 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.052491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.079128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a9007-4c31-4040-8bd4-adc28fca060c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.079745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9007-4c31-4040-8bd4-adc28fca060c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.080031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9007-4c31-4040-8bd4-adc28fca060c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.080308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9007-4c31-4040-8bd4-adc28fca060c None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.081517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a9007-4c31-4040-8bd4-adc28fca060c None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:08.081824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a9007-4c31-4040-8bd4-adc28fca060c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.083216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a9007-4c31-4040-8bd4-adc28fca060c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.085563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c88c5-d2c7-40ca-a90c-a0b021a3eefe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.091388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 38/78] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:08.092576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885e8e-fc35-42fc-a2af-879a32d9a6b5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.092866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885e8e-fc35-42fc-a2af-879a32d9a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.093148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41885e8e-fc35-42fc-a2af-879a32d9a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.111112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-41885e8e-fc35-42fc-a2af-879a32d9a6b5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:08.112322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-41885e8e-fc35-42fc-a2af-879a32d9a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:08.119029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.119659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.119939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.120214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.134977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.136455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.138344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 41/79] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:07 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:08.141162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.179338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 39/80] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:08.192548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885e8e-fc35-42fc-a2af-879a32d9a6b5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.237728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.258082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f808-a3f9-4366-9666-880089f1944b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.286823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.295227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41885e8e-fc35-42fc-a2af-879a32d9a6b5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.296214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.296865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.297153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.298140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.330549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.331796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.332077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.332453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.333046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:08.333351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.334881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.348801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 40/81] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:08.348801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.379757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.381643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.457459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26faa8-ad2e-403c-93fb-6098e71c28b0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.474119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.489019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 42/82] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:08.489875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.498003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.498656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.498946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.499230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.500400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.501892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.503534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 41/83] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:08.504305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.516067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.591867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76288c-0d7a-4459-84ef-76db98ff3fdd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.605758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03027b-72ec-4afa-8567-09473d08a2f5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.626378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.626998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.627281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.627558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.640071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.640764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.641051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.641328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.642592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.644079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.645740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 42/84] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:08.646524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.698721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.704302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.705833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.731956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.747088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee0232-7499-4d1b-bd98-13c4830c6588 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.782201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.782906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.783193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.783519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.784797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.786407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.788132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 43/85] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:08.789007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.806203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 43/86] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:08.806917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.895741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151353f-da78-48bf-90b1-45b4d8722713 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.903230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8414225-8945-4865-bd4d-0534961d1ffc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:08.914970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.928421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:08.929585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.930392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.930678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.930957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:08.932084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:08.933585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:08.935202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 44/87] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:08.935971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:08.937413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:08.938025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:08.938317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:08.938599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.008501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.009922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.034378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246dea-153c-432e-a59f-68c2e91b271b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.068518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.069136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.069428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.069711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.106365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 44/88] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:09.109302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.124303 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:09.136899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:09.137437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.139295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.207462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37004e87-4e09-415f-b629-0d88a51e0fff None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.238651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 45/89] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:09.243407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.243499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.243499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.243499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.243499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.243867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.244215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.265154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 45/90] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:41:09 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:09.265904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.354099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:09.369541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6af67c-d051-4d82-a5ed-8dfe66c7df8d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.381099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:09.405864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a2235-2d28-4ea8-984c-0d35db6d291c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.406478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.407516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.407606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.407862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.410524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.412032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.413736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 46/91] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:09 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:09.414518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.448929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.449560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.449849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.450125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.450874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=683fbdc2cecc4c059e82825e29207432) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:09.451376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.452853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.460451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 46/92] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:09 2022] GET /identity/v3/role_assignments?user.id=683fbdc2cecc4c059e82825e29207432&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:09.460451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.554458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7462b41-5289-4bf5-b6d7-1219c5a397ff None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.599425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63284680-11d9-4e77-b3ba-1a9fe588cfbe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.615547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.616678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.617462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.618058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.619632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.622058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.623911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 47/93] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:09 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:09.624991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.649973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.650772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.651112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.651397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] PATH_INFO: `/v3/projects/8f61199e047f4b0b874d3c30cc04e28d` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.652622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] RBAC: Authorizing `identity:get_project(project_id=8f61199e047f4b0b874d3c30cc04e28d)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.654235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.656126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 47/94] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:09 2022] GET /identity/v3/projects/8f61199e047f4b0b874d3c30cc04e28d => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:09.657036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:09.657610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.679524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:09.750148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b031ed-2bba-4930-86d0-fb10700ee9a1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.781320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca673db4-1d99-4a40-a6b5-eb914f2aea93 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:09.789954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.791164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.791627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.792208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.793179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] RBAC: Adding query filter params (role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=bc03d5a587d1460788d92e5aee9807ad) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:09.793675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.795560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.804557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 48/95] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:09 2022] GET /identity/v3/role_assignments?user.id=bc03d5a587d1460788d92e5aee9807ad&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:09.805858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:09.827036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec8b57-54ec-4aa9-8651-65819519eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:09.827663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8b57-54ec-4aa9-8651-65819519eaed None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:09.827947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8b57-54ec-4aa9-8651-65819519eaed None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:09.828222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec8b57-54ec-4aa9-8651-65819519eaed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:09.828997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec8b57-54ec-4aa9-8651-65819519eaed None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=bc03d5a587d1460788d92e5aee9807ad) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:09.829309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec8b57-54ec-4aa9-8651-65819519eaed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:09.830853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec8b57-54ec-4aa9-8651-65819519eaed None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:09.841680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 48/96] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:09 2022] GET /identity/v3/role_assignments?user.id=bc03d5a587d1460788d92e5aee9807ad&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:09.938030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:09.964280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faebd74-79a8-4525-87af-a5caee22078c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:10.016925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade54843-e2e8-425b-93b1-67f086a23aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:10.017569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54843-e2e8-425b-93b1-67f086a23aeb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:10.017849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54843-e2e8-425b-93b1-67f086a23aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:10.018123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade54843-e2e8-425b-93b1-67f086a23aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:10.019083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade54843-e2e8-425b-93b1-67f086a23aeb None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=8f61199e047f4b0b874d3c30cc04e28d, user.id=bc03d5a587d1460788d92e5aee9807ad) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:10.019396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade54843-e2e8-425b-93b1-67f086a23aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:10.020949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade54843-e2e8-425b-93b1-67f086a23aeb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:10.034965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 49/97] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:09 2022] GET /identity/v3/role_assignments?user.id=bc03d5a587d1460788d92e5aee9807ad&scope.project.id=8f61199e047f4b0b874d3c30cc04e28d&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:12.195271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c37ec-d49c-42d1-9eba-fe648c007dc1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.195787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c37ec-d49c-42d1-9eba-fe648c007dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.195859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c37ec-d49c-42d1-9eba-fe648c007dc1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.197328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 49/98] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:12.202487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625bf4-9d5c-4486-a444-f5fd15c9f614 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.202917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625bf4-9d5c-4486-a444-f5fd15c9f614 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.203087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c625bf4-9d5c-4486-a444-f5fd15c9f614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.232529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8c625bf4-9d5c-4486-a444-f5fd15c9f614 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:12.233946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8c625bf4-9d5c-4486-a444-f5fd15c9f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:12.326683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 50/99] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:12.483461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a900175-e717-401a-993f-3f7e8fee3624 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.483953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a900175-e717-401a-993f-3f7e8fee3624 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.484372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a900175-e717-401a-993f-3f7e8fee3624 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.485876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 50/100] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:12.491437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51435-f47c-4654-96dd-9f0e861c6da5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.491909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51435-f47c-4654-96dd-9f0e861c6da5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.492326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51435-f47c-4654-96dd-9f0e861c6da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.517489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc516-423c-4166-88c3-22671f5033cb None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.517992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc516-423c-4166-88c3-22671f5033cb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.518514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dc516-423c-4166-88c3-22671f5033cb None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.520002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 51/101] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:41:12.520947 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d3e51435-f47c-4654-96dd-9f0e861c6da5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:12.522392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d3e51435-f47c-4654-96dd-9f0e861c6da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:12.524910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc1597-ca15-4c42-b22b-ad1ea76b8dcd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.525397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc1597-ca15-4c42-b22b-ad1ea76b8dcd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.525881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc1597-ca15-4c42-b22b-ad1ea76b8dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.552114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c4fc1597-ca15-4c42-b22b-ad1ea76b8dcd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:12.554809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c4fc1597-ca15-4c42-b22b-ad1ea76b8dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:12.669273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 51/102] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:12.678239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71609432-890c-40c9-a632-ca9a4c0db5ce None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.678716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71609432-890c-40c9-a632-ca9a4c0db5ce None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.679138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71609432-890c-40c9-a632-ca9a4c0db5ce None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.680636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 52/103] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:12.687179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b9da7-4578-472e-9bad-1904543b653c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.687624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b9da7-4578-472e-9bad-1904543b653c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.688060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b9da7-4578-472e-9bad-1904543b653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.694267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 52/104] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:12.720123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7e7b9da7-4578-472e-9bad-1904543b653c None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:12.720541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc1597-ca15-4c42-b22b-ad1ea76b8dcd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:12.721669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e7b9da7-4578-472e-9bad-1904543b653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:12.735767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:12.740098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:12.871518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 53/105] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:12.873147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0e97-7c79-40a1-87cd-0706aaf3417f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.873660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0e97-7c79-40a1-87cd-0706aaf3417f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.874139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b0e97-7c79-40a1-87cd-0706aaf3417f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.875598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 54/106] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:12.881513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc30993-a913-4148-906f-65c961fcd1f8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.882027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc30993-a913-4148-906f-65c961fcd1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.882502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc30993-a913-4148-906f-65c961fcd1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.914693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dfc30993-a913-4148-906f-65c961fcd1f8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:12.916814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dfc30993-a913-4148-906f-65c961fcd1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:12.919046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc1597-ca15-4c42-b22b-ad1ea76b8dcd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:12.980074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2b572-19e6-4dbe-8e11-dbce5411acd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:12.981557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b572-19e6-4dbe-8e11-dbce5411acd9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:12.982410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b572-19e6-4dbe-8e11-dbce5411acd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:12.983461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b572-19e6-4dbe-8e11-dbce5411acd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:12.995147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2b572-19e6-4dbe-8e11-dbce5411acd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-7eb2b572-19e6-4dbe-8e11-dbce5411acd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:13.000649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:13.001526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:13.002282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:13.004574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 53/107] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:41:13.006053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d416a-7734-44d8-ae64-6d9b6960b19d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.006540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d416a-7734-44d8-ae64-6d9b6960b19d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.007015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d416a-7734-44d8-ae64-6d9b6960b19d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.013563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 54/108] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:13.014971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d416a-7734-44d8-ae64-6d9b6960b19d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.024016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 55/109] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:13.025655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7f23f-ae6f-4a73-8350-51a74783c486 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.026149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7f23f-ae6f-4a73-8350-51a74783c486 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.026625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7f23f-ae6f-4a73-8350-51a74783c486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.054021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fff7f23f-ae6f-4a73-8350-51a74783c486 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:13.056338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fff7f23f-ae6f-4a73-8350-51a74783c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:13.128327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.160220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 56/110] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:13.165053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7f23f-ae6f-4a73-8350-51a74783c486 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.167367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d416a-7734-44d8-ae64-6d9b6960b19d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.167830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.213082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.213733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.214047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.214337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.215013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:13.215318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:13.216849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:13.225863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 55/111] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:13.226850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.277390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7f23f-ae6f-4a73-8350-51a74783c486 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.312453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.313104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.313391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.313828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.314960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:13.316982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:13.318552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 57/112] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:13.319328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.340300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8802f-9e39-4718-be27-7168ff19e615 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.371525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.378375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.379168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.379452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.379776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.389174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.391816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:13.397766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:13.398819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:13.399721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 56/113] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:13.402586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.425762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054a00-284e-4a40-bdc7-5030fc7dfbe9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.460695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.461340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.461629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.461910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.472082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:13.476877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:13.477708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:13.478463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 58/114] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:13.479087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.504137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf239ec-c7c8-4c06-b874-d7d56788a9d0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.537596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.538220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.538509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.538821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] PATH_INFO: `/v3/users/683fbdc2cecc4c059e82825e29207432` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.539985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] RBAC: Authorizing `identity:get_user(user_id=683fbdc2cecc4c059e82825e29207432)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:13.541575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:13.543164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 57/115] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/users/683fbdc2cecc4c059e82825e29207432 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:13.543941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.582934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd50a7-f6e4-482f-a6b0-b052a5e3a047 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.603084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.613249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.619415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.620033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.620318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.620626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.621281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:13.623022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:13.645805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f61a2-69b8-45e2-b006-cfc335c56547 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.650143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 59/116] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:41:13 2022] POST /identity/v3/projects => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:13.651023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.683263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.683925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.684239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.684656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.697381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:13.704223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:13.705262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:13.706016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 58/117] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:13.707345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.769531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f573a-4fcb-4b33-b949-e813c6f4ae99 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.811535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.812083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.812371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.812700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.813384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:13.813692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:13.815117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:13.818421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaa22f-a9f7-479b-9f47-e52f6df4faae None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.825010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 60/118] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:13.826215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.839947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.859589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.860233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.860574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.860871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.871821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:13.875583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:13.877228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:13.878260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 59/119] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:13.879729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.941214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb589b1-c7f0-4588-b557-721c68058165 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:13.978659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:13.979295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:13.979563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:13.979851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:13.980556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:13.980866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:13.982269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:13.991112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 61/120] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:13.993296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:13.996720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199dd56-82bb-4fb1-ad7e-084631f819d1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.031833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.032514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.032806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.033089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.034999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.036531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.038380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 60/121] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.043578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.092512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.103539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7269b0-d112-4b11-a30c-28ec8b9482a2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.110628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.140933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.141651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.142009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.142366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.143111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:14.144011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.145503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.151807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e7a99-f0a7-4053-b33a-27b460ea76e6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.153760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 62/122] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.158438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.192180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.192981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.193327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.193666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.194891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.196643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.198613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 61/123] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.203879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.258339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6928-58c9-4237-b53d-0474b916b267 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.297012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.297722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.298012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.298289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.298962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:14.299267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.301273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.309280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ba43-393f-4b3a-adb9-68fbd596ff7c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.309700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 63/124] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.313189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.329363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.350937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.353303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.353940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.354246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.354478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] PATH_INFO: `/v3/users/5068a1a96fe94e3091738d3b0d908673` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.368489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] RBAC: Authorizing `identity:get_user(user_id=5068a1a96fe94e3091738d3b0d908673)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.370502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.376773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 62/125] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/users/5068a1a96fe94e3091738d3b0d908673 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.376773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.429299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7de006-1a62-4a0a-9c52-67121ee90383 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.466106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.466866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.467453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.467795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/683fbdc2cecc4c059e82825e29207432/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.470532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] RBAC: Authorizing `identity:create_grant(project_id=4e631e8904fe4c058b2f79e89c9fbb3f, user_id=683fbdc2cecc4c059e82825e29207432, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.473086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.478717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ec36d-43c1-4c22-be0a-9df1df9af3d2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.487003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 64/126] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:14 2022] PUT /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/683fbdc2cecc4c059e82825e29207432/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:14.488718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.527254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.528288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.528755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.529033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.530254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.531969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.533739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 63/127] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.540081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.597877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.632050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.652152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bbb02-2485-4796-975c-fe92286815ac None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.680881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56768209-3fc8-4a75-b39d-b4e7a3544c42 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.700655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.702003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.702442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.702915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.704076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.705603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.707985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 65/128] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.708668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.722872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.723508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.723791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.724414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.725257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.726693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.732477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 64/129] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.732477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.849872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17bab-62c3-45b3-b109-bec69cbdb679 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.854978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b3c2f-7222-41f0-81de-f9144573a6a1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:14.868981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.886392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.886945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.887528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.887528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.908233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:14.909233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:14.909721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:14.910722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:14.912345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.914986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:14.916109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:14.918987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 65/130] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:14.920282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:14.963011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:14.964605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:15.036761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21528872-db3f-4ba1-ba2b-fccd9a459312 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:15.077249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:15.077445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 66/131] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:15.078211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:15.078318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:15.078531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:15.078812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/bc03d5a587d1460788d92e5aee9807ad/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:15.082377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e631e8904fe4c058b2f79e89c9fbb3f, user_id=bc03d5a587d1460788d92e5aee9807ad, role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:15.083970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:15.103993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 66/132] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:14 2022] PUT /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/bc03d5a587d1460788d92e5aee9807ad/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:15.105107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:15.149789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:15.160761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:15.199750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1104de-80b6-4930-9c26-2f0654d71ae0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:15.238764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:15.239415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:15.239699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:15.239981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] PATH_INFO: `/v3/projects/8f61199e047f4b0b874d3c30cc04e28d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:15.241623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] RBAC: Authorizing `identity:get_project(project_id=8f61199e047f4b0b874d3c30cc04e28d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:15.242691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:15.244707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 67/133] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:15 2022] GET /identity/v3/projects/8f61199e047f4b0b874d3c30cc04e28d => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:15.245514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:15.256755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48975e-9bf2-47a1-9123-0844835b82d2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:15.296630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:15.296630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:15.296630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:15.296630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/bc03d5a587d1460788d92e5aee9807ad/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:15.298819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e631e8904fe4c058b2f79e89c9fbb3f, user_id=bc03d5a587d1460788d92e5aee9807ad, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:15.301066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:15.330511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 67/134] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:15 2022] PUT /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/bc03d5a587d1460788d92e5aee9807ad/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:15.331466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:15.388748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ee9c7-e412-422f-b147-79a146957f71 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:15.419933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:15.433141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:15.435168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:15.436567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:15.437172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:15.440705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:15.442514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:15.445532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 68/135] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:15 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:15.455006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:15.500186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:15.508299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7e7a-0efb-41ae-a3d1-d8efa0382bc3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:15.550246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2360e-a9e9-4f1c-8b27-dd13b9525eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:15.551349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2360e-a9e9-4f1c-8b27-dd13b9525eda None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:15.551952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2360e-a9e9-4f1c-8b27-dd13b9525eda None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:15.552451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2360e-a9e9-4f1c-8b27-dd13b9525eda None admin] PATH_INFO: `/v3/projects/8f61199e047f4b0b874d3c30cc04e28d/users/bc03d5a587d1460788d92e5aee9807ad/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:15.554967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2360e-a9e9-4f1c-8b27-dd13b9525eda None admin] RBAC: Authorizing `identity:create_grant(project_id=8f61199e047f4b0b874d3c30cc04e28d, user_id=bc03d5a587d1460788d92e5aee9807ad, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:15.556668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2360e-a9e9-4f1c-8b27-dd13b9525eda None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:15.579433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 68/136] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:15 2022] PUT /identity/v3/projects/8f61199e047f4b0b874d3c30cc04e28d/users/bc03d5a587d1460788d92e5aee9807ad/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:15.621164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965897e3-7f8f-467a-9266-4f72830835ac None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:15.673170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88995da3-fdfc-4fac-9e5f-817d03c73afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:15.674148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995da3-fdfc-4fac-9e5f-817d03c73afa None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:15.674708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995da3-fdfc-4fac-9e5f-817d03c73afa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:15.675348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995da3-fdfc-4fac-9e5f-817d03c73afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:15.676421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995da3-fdfc-4fac-9e5f-817d03c73afa None admin] RBAC: Adding query filter params (role.id=ebdde59a9acf4f6aab6348992db4ade2, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=5068a1a96fe94e3091738d3b0d908673) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:15.676962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995da3-fdfc-4fac-9e5f-817d03c73afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:15.678668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995da3-fdfc-4fac-9e5f-817d03c73afa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:15.689164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 69/137] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:15 2022] GET /identity/v3/role_assignments?user.id=5068a1a96fe94e3091738d3b0d908673&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=ebdde59a9acf4f6aab6348992db4ade2 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:16.033533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8ffa-cb10-4d71-a00b-3300f78bbccd None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:16.034709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8ffa-cb10-4d71-a00b-3300f78bbccd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:16.035201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8ffa-cb10-4d71-a00b-3300f78bbccd None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:16.036788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 69/138] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:16.042380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b30c80-8b15-4708-be07-4ebcad1fa291 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:16.042916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b30c80-8b15-4708-be07-4ebcad1fa291 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:16.043392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b30c80-8b15-4708-be07-4ebcad1fa291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:16.062419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b8b30c80-8b15-4708-be07-4ebcad1fa291 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:16.063982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b8b30c80-8b15-4708-be07-4ebcad1fa291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:16.126296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:16.152430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 70/139] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:16.694010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a8ffa-cb10-4d71-a00b-3300f78bbccd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:16.814646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a8ffa-cb10-4d71-a00b-3300f78bbccd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:16.851361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c4200-c06e-4b90-abcf-4caa89a2fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:16.852079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4200-c06e-4b90-abcf-4caa89a2fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:16.852498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4200-c06e-4b90-abcf-4caa89a2fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:16.852897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c4200-c06e-4b90-abcf-4caa89a2fdd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:16.854470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c4200-c06e-4b90-abcf-4caa89a2fdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:16.856037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c4200-c06e-4b90-abcf-4caa89a2fdd3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:16.857740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 70/140] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:16.864041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b30c80-8b15-4708-be07-4ebcad1fa291 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:16.948978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713c16-8189-47ed-9302-066d937f92f6 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:16.949467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713c16-8189-47ed-9302-066d937f92f6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:16.949849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713c16-8189-47ed-9302-066d937f92f6 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:16.951358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 71/141] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:16.956506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd79b-9b14-4df5-9b8b-56e1f19f5c58 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:16.956918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd79b-9b14-4df5-9b8b-56e1f19f5c58 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:16.957300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd79b-9b14-4df5-9b8b-56e1f19f5c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:16.993105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-eedbd79b-9b14-4df5-9b8b-56e1f19f5c58 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:16.996219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-eedbd79b-9b14-4df5-9b8b-56e1f19f5c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:17.033520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b30c80-8b15-4708-be07-4ebcad1fa291 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:17.045903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:17.096601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144745e4-8b7c-42a2-b8a0-3163d9bc3cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:17.097162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144745e4-8b7c-42a2-b8a0-3163d9bc3cbf None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:17.097513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144745e4-8b7c-42a2-b8a0-3163d9bc3cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:17.097794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144745e4-8b7c-42a2-b8a0-3163d9bc3cbf None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:17.098466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144745e4-8b7c-42a2-b8a0-3163d9bc3cbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:17.100526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144745e4-8b7c-42a2-b8a0-3163d9bc3cbf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:17.150200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 71/142] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:41:16 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:17.185950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 72/143] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 08:41:17.655176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe82f1-383a-444c-aeec-6a4938ed5160 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:17.655490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe82f1-383a-444c-aeec-6a4938ed5160 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:17.655744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe82f1-383a-444c-aeec-6a4938ed5160 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:17.657411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 72/144] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:17.663198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f90b7-3026-4ba0-a96d-3aeecc43325d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:17.663494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f90b7-3026-4ba0-a96d-3aeecc43325d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:17.663720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe82f1-383a-444c-aeec-6a4938ed5160 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:17.663816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f90b7-3026-4ba0-a96d-3aeecc43325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:17.697494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-370f90b7-3026-4ba0-a96d-3aeecc43325d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:17.700723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-370f90b7-3026-4ba0-a96d-3aeecc43325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:17.742935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:17.827295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 73/145] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:17.838271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe82f1-383a-444c-aeec-6a4938ed5160 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:17.875823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:17.876603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:17.876831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:17.877140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:17.888574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:17.894026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:17.894868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:17.895614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 73/146] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:41:17.902273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f90b7-3026-4ba0-a96d-3aeecc43325d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:18.001183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:18.019577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f90b7-3026-4ba0-a96d-3aeecc43325d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:18.057623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:18.058250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.058536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.058815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.059501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:18.059809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:18.061221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:18.072060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 74/147] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:18.077858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:18.196342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0e29f-fee3-4d16-a1b5-08c259003c20 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:18.198895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:18.235192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:18.235837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.236125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.236415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] PATH_INFO: `/v3/users/683fbdc2cecc4c059e82825e29207432` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.237720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] RBAC: Authorizing `identity:get_user(user_id=683fbdc2cecc4c059e82825e29207432)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:18.239253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:18.241642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:18.242942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 74/148] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:18 2022] GET /identity/v3/users/683fbdc2cecc4c059e82825e29207432 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:18.251429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:18.429405 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c00594-416d-414e-bb87-3cd9e0fe5cad None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:18.432636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ee628-7ac9-4d95-aab0-bf1a8f0f6ff9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:18.484758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82b040-773a-45c1-b56a-87751ff108aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:18.485397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b040-773a-45c1-b56a-87751ff108aa None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.485767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b040-773a-45c1-b56a-87751ff108aa None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.486047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82b040-773a-45c1-b56a-87751ff108aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.507117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82b040-773a-45c1-b56a-87751ff108aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2c82b040-773a-45c1-b56a-87751ff108aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:18.512338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:18.513458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:18.514239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:18.514829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 75/149] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:18.523288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59c27e-5a2f-447d-b0df-cb4d15e52c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:18.523917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c27e-5a2f-447d-b0df-cb4d15e52c6c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.524194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c27e-5a2f-447d-b0df-cb4d15e52c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.524489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59c27e-5a2f-447d-b0df-cb4d15e52c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.528274 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997781-e4bc-4728-b589-fd65e3154bd6 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.528601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997781-e4bc-4728-b589-fd65e3154bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.528875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb997781-e4bc-4728-b589-fd65e3154bd6 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.530220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 76/150] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:18 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:18.531899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb997781-e4bc-4728-b589-fd65e3154bd6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:18.552509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:18.615821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:18.656621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59c27e-5a2f-447d-b0df-cb4d15e52c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:18.658201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59c27e-5a2f-447d-b0df-cb4d15e52c6c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:18.668117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb997781-e4bc-4728-b589-fd65e3154bd6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:18.719001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302091b-ac25-46ac-9a23-8ceaa1669332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:18.719606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302091b-ac25-46ac-9a23-8ceaa1669332 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.719825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302091b-ac25-46ac-9a23-8ceaa1669332 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.720089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302091b-ac25-46ac-9a23-8ceaa1669332 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.720952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302091b-ac25-46ac-9a23-8ceaa1669332 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:18.721131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302091b-ac25-46ac-9a23-8ceaa1669332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:18.722592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302091b-ac25-46ac-9a23-8ceaa1669332 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:18.731729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 77/151] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:18.733112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578d00-14d0-4604-9ebd-34eb472bf3ee None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.733405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578d00-14d0-4604-9ebd-34eb472bf3ee None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.733686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d578d00-14d0-4604-9ebd-34eb472bf3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.753834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8d578d00-14d0-4604-9ebd-34eb472bf3ee None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:18.755055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8d578d00-14d0-4604-9ebd-34eb472bf3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:18.793538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 75/152] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 08:41:18.795424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7722-50db-4d21-ad02-cd730a5653d9 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.796075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7722-50db-4d21-ad02-cd730a5653d9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.796569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7722-50db-4d21-ad02-cd730a5653d9 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.798036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 76/153] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:18.799430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4c84-e1c8-4b42-9895-2c436b5f070a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:18.800465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4c84-e1c8-4b42-9895-2c436b5f070a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:18.800957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c4c84-e1c8-4b42-9895-2c436b5f070a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:18.802368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 77/154] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:18.803338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4c84-e1c8-4b42-9895-2c436b5f070a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:18.843442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:18.853362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 78/155] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:18.854518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d578d00-14d0-4604-9ebd-34eb472bf3ee None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:18.918079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:18.975578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c4c84-e1c8-4b42-9895-2c436b5f070a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:19.045327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588b2d4-c81d-40e2-8e45-5590c01c73e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:19.045982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b2d4-c81d-40e2-8e45-5590c01c73e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:19.046266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b2d4-c81d-40e2-8e45-5590c01c73e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:19.046547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588b2d4-c81d-40e2-8e45-5590c01c73e7 None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:19.050361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588b2d4-c81d-40e2-8e45-5590c01c73e7 None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:19.051828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588b2d4-c81d-40e2-8e45-5590c01c73e7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:19.055574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d578d00-14d0-4604-9ebd-34eb472bf3ee None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:19.058062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 78/156] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:18 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:19.059396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944594-b67f-4d82-ae6c-5773f7907c5b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:19.059679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944594-b67f-4d82-ae6c-5773f7907c5b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:19.059957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30944594-b67f-4d82-ae6c-5773f7907c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:19.105030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-30944594-b67f-4d82-ae6c-5773f7907c5b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:19.106295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-30944594-b67f-4d82-ae6c-5773f7907c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:19.116599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675a7e0-75ea-4787-a4f4-5fa7ba74bee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:19.117365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a7e0-75ea-4787-a4f4-5fa7ba74bee2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:19.117651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a7e0-75ea-4787-a4f4-5fa7ba74bee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:19.117924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675a7e0-75ea-4787-a4f4-5fa7ba74bee2 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:19.119830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675a7e0-75ea-4787-a4f4-5fa7ba74bee2 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:19.121569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675a7e0-75ea-4787-a4f4-5fa7ba74bee2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:19.123316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 79/157] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:18 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:19.124679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892d07-e799-45ca-a3a4-4de1ef271e1f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:19.124964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892d07-e799-45ca-a3a4-4de1ef271e1f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:19.125245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3892d07-e799-45ca-a3a4-4de1ef271e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:19.160697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d3892d07-e799-45ca-a3a4-4de1ef271e1f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:19.161903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d3892d07-e799-45ca-a3a4-4de1ef271e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:19.253410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:19.270806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 79/158] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:19.271681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30944594-b67f-4d82-ae6c-5773f7907c5b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:19.273308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 80/159] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:19.274144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3892d07-e799-45ca-a3a4-4de1ef271e1f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:19.455898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:19.503658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3892d07-e799-45ca-a3a4-4de1ef271e1f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:19.528600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30944594-b67f-4d82-ae6c-5773f7907c5b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:19.562058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:19.566027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:19.566524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:19.567140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:19.568127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=683fbdc2cecc4c059e82825e29207432) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:19.568677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:19.570303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:19.593751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 81/160] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:19 2022] GET /identity/v3/role_assignments?user.id=683fbdc2cecc4c059e82825e29207432&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:19.599848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:19.608590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:19.609570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:19.613806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:19.614339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:19.730128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:19.732050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:19.740408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:19.826145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:19.850698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2183b-47a4-4cb1-be6d-6025d6192e01 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:19.863101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 80/161] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:19.868613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:19.921972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:19.922745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:19.922939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:19.923174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:19.948337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:19.954221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:19.955203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:19.956019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 82/162] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:19.956715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:19.982206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6919c62-5b11-4119-93df-d420474c1715 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.020206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.021277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.021753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.022245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.023621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:20.025465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:20.027401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 81/163] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:19 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:20.028413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.072024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:20.140665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da8cce-d228-483a-81d9-96eafaddba53 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.141166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1a834-b738-48de-81c8-5cf39ff8d462 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.176582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:20.181593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.182564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.183039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.183547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.184478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:20.184996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:20.187166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:20.197480 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 82/164] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:20.198680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.205719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.206914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.207198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.207473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.229679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:20.234941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:20.235806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:20.236614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:20.244829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 83/165] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:20.245760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.327844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:20.332411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f743776-cc30-468b-b704-413a3b04efec None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.378988 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.379340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4670-097c-4915-8e7c-7d7f26e69aa8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.380168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.384812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.385320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.386470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] RBAC: Adding query filter params (role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=bc03d5a587d1460788d92e5aee9807ad) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:20.387058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:20.397356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:20.408704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 83/166] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/role_assignments?user.id=bc03d5a587d1460788d92e5aee9807ad&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:20.410569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.422017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.423226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.423226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.423226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.450242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:20.455717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:20.457024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 84/167] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:20.457835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.522708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:20.587481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb8c27-ac80-48cf-bbe7-a4f82f0fda92 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.651116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.652218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.652722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.653231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.654598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:20.656272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:20.658115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 84/168] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:20.659621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.672531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8f87-cdce-4a2c-88e4-990e82367e53 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.694475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:20.746104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.746758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.747007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.747280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.748341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:20.748341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:20.750082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:20.763723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 85/169] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:20.764622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.774463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718a22-ab8f-440c-87d2-7d30e844284c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.811121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.812085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.812595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.813067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.813935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:20.814512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:20.816191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:20.825246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 85/170] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:20.826360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:20.920640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f4dd-701a-4f0a-a71a-1b61d433faa6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.922514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:20.933497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:20.942556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5859c-c344-47a7-b01c-5202829640ac None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:20.972568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.973451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.973728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.974014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.980764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:20.981634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:20.982120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:20.982608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] PATH_INFO: `/v3/users/5068a1a96fe94e3091738d3b0d908673` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:20.984373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] RBAC: Authorizing `identity:get_user(user_id=5068a1a96fe94e3091738d3b0d908673)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:20.986206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:20.988914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 86/171] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/users/5068a1a96fe94e3091738d3b0d908673 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:20.989906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.069381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.070872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.098864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9978a-9742-4dd3-a918-ec1f6c352229 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:21.143095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fa1f9-d939-4d2c-96c9-cef2efad8356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:21.144729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa1f9-d939-4d2c-96c9-cef2efad8356 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.145026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa1f9-d939-4d2c-96c9-cef2efad8356 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.145307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa1f9-d939-4d2c-96c9-cef2efad8356 None admin] PATH_INFO: `/v3/users/bc03d5a587d1460788d92e5aee9807ad` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.146747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fa1f9-d939-4d2c-96c9-cef2efad8356 None admin] RBAC: Authorizing `identity:get_user(user_id=bc03d5a587d1460788d92e5aee9807ad)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.148962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fa1f9-d939-4d2c-96c9-cef2efad8356 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.150844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 87/172] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/users/bc03d5a587d1460788d92e5aee9807ad => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:21.152322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38584b-91b1-42d2-9c67-7b41114b7dcf None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.152641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38584b-91b1-42d2-9c67-7b41114b7dcf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.152921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38584b-91b1-42d2-9c67-7b41114b7dcf None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.154764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 88/173] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:21.155760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38584b-91b1-42d2-9c67-7b41114b7dcf None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.192456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:21.197930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 86/174] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:21.198774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.201154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:21.271397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38584b-91b1-42d2-9c67-7b41114b7dcf None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:21.299738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb0b7-f02b-4121-a440-a3149b2046bc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:21.309521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79355ceb-3446-4008-a763-14ed94229672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:21.310155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355ceb-3446-4008-a763-14ed94229672 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.310436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355ceb-3446-4008-a763-14ed94229672 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.310863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79355ceb-3446-4008-a763-14ed94229672 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.311826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79355ceb-3446-4008-a763-14ed94229672 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.313312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79355ceb-3446-4008-a763-14ed94229672 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.315096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 89/175] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:21 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:21.316589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8edb2d-8777-451c-a0d9-76d9b38a0312 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.316872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8edb2d-8777-451c-a0d9-76d9b38a0312 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.317150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8edb2d-8777-451c-a0d9-76d9b38a0312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.335099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8f8edb2d-8777-451c-a0d9-76d9b38a0312 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:21.336035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:21.336287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8f8edb2d-8777-451c-a0d9-76d9b38a0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:21.337789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.337789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.337789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.411276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 90/176] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:21.412636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf6dbd-82cc-4e66-baf8-a857993d36b3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.412919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf6dbd-82cc-4e66-baf8-a857993d36b3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.413186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf6dbd-82cc-4e66-baf8-a857993d36b3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.414557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 91/177] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:21.419302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf6dbd-82cc-4e66-baf8-a857993d36b3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.420060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.421872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.424186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:21.452234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:21.539561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf6dbd-82cc-4e66-baf8-a857993d36b3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:21.565015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 87/178] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:21.566056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.586085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822627d0-937c-4913-a8da-ebba45c53957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:21.587059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822627d0-937c-4913-a8da-ebba45c53957 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.587817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822627d0-937c-4913-a8da-ebba45c53957 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.588339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822627d0-937c-4913-a8da-ebba45c53957 None admin] PATH_INFO: `/v3/projects/8f61199e047f4b0b874d3c30cc04e28d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.590237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822627d0-937c-4913-a8da-ebba45c53957 None admin] RBAC: Authorizing `identity:get_project(project_id=8f61199e047f4b0b874d3c30cc04e28d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.591875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822627d0-937c-4913-a8da-ebba45c53957 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.594580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 92/179] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:21 2022] GET /identity/v3/projects/8f61199e047f4b0b874d3c30cc04e28d => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:21.596905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c26cd5-872a-42df-b0e3-b393622f8de7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.597671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c26cd5-872a-42df-b0e3-b393622f8de7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.598146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c26cd5-872a-42df-b0e3-b393622f8de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.619336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d6c26cd5-872a-42df-b0e3-b393622f8de7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:21.620567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d6c26cd5-872a-42df-b0e3-b393622f8de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:21.678219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c5736-acec-4d83-bd74-66b9b2802f53 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:21.680152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:21.691413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 93/180] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:21.692266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c26cd5-872a-42df-b0e3-b393622f8de7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.719937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:21.720559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.720834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.721116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/5068a1a96fe94e3091738d3b0d908673/roles/ebdde59a9acf4f6aab6348992db4ade2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.723083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e631e8904fe4c058b2f79e89c9fbb3f, user_id=5068a1a96fe94e3091738d3b0d908673, role_id=ebdde59a9acf4f6aab6348992db4ade2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.723685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:21.724577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.738197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 88/181] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:21 2022] PUT /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/users/5068a1a96fe94e3091738d3b0d908673/roles/ebdde59a9acf4f6aab6348992db4ade2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:21.741866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.818064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c26cd5-872a-42df-b0e3-b393622f8de7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:21.867253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea0622-59c7-432e-a62e-2d2844c47566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:21.867938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0622-59c7-432e-a62e-2d2844c47566 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.868292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0622-59c7-432e-a62e-2d2844c47566 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.868697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea0622-59c7-432e-a62e-2d2844c47566 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.869999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0622-59c7-432e-a62e-2d2844c47566 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.871489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea0622-59c7-432e-a62e-2d2844c47566 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.878182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 94/182] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:21 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:21.879299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714ad9-18aa-4b4e-a164-7c10308068de None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.879526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714ad9-18aa-4b4e-a164-7c10308068de None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.879798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714ad9-18aa-4b4e-a164-7c10308068de None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.881345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 95/183] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:21.883640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714ad9-18aa-4b4e-a164-7c10308068de None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.889703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca671bed-f520-415d-a787-f0e3ee187790 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:21.935127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:21.935743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:21.936022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:21.936345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:21.937532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=8f61199e047f4b0b874d3c30cc04e28d, user.id=bc03d5a587d1460788d92e5aee9807ad) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:21.937650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:21.939074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:21.946946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 89/184] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:21 2022] GET /identity/v3/role_assignments?user.id=bc03d5a587d1460788d92e5aee9807ad&scope.project.id=8f61199e047f4b0b874d3c30cc04e28d&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:21.947790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:21.986403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.005606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.016449 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714ad9-18aa-4b4e-a164-7c10308068de None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.055228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d22d2f-7daf-49e4-91ea-ddb504945df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.056168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22d2f-7daf-49e4-91ea-ddb504945df0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.056664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22d2f-7daf-49e4-91ea-ddb504945df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.057084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d22d2f-7daf-49e4-91ea-ddb504945df0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.069631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d22d2f-7daf-49e4-91ea-ddb504945df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-94d22d2f-7daf-49e4-91ea-ddb504945df0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:22.074559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:22.075554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:22.076809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 96/185] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:22.082345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc2890-9d26-4844-895d-cebed0c82d2d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.082644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc2890-9d26-4844-895d-cebed0c82d2d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.082921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc2890-9d26-4844-895d-cebed0c82d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.086791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531b0b-774c-48c0-a7dc-3d1b66b99192 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.102283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6ebc2890-9d26-4844-895d-cebed0c82d2d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:22.103583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6ebc2890-9d26-4844-895d-cebed0c82d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:22.136878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.137845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.138649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.139141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.140086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=bc03d5a587d1460788d92e5aee9807ad) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:22.140636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:22.142287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:22.148605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 90/186] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:21 2022] GET /identity/v3/role_assignments?user.id=bc03d5a587d1460788d92e5aee9807ad&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:22.153365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.183116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 97/187] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:22.184028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc2890-9d26-4844-895d-cebed0c82d2d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.308314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.326175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacaf02b-369c-4171-8608-f56d5e335702 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.354695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.368863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.369509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.369786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.370061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.378734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc2890-9d26-4844-895d-cebed0c82d2d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.384307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:22.389404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:22.390330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:22.391114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 91/188] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:22.398789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.430186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.431091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.431376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.431646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.432331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:22.434705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:22.436668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:22.452321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 98/189] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:22.459191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.540571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2a722-9e47-476b-bd03-482b9ba2a907 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.577489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f06a8e-1b42-4394-b3b2-b779ab3dbba8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.586342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.586973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.587254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.587534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.588219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:22.588560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:22.589946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:22.599108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 92/190] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:22.599745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.618583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.619237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.619508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.619784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] PATH_INFO: `/v3/users/b0a62e928e2f478f87d9c714790145c5` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.620906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.635290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a62e928e2f478f87d9c714790145c5)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:22.636834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:22.638722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 99/191] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/users/b0a62e928e2f478f87d9c714790145c5 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:22.639490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.642843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.717045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67e475-fa7b-4eee-a3bf-94a7430fc8c0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.743746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051179d-2cdf-40de-9c6a-72df8c703d62 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.756780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.757416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.757737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.758022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.759134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:22.760635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:22.762200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 93/192] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:22.762969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.785618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.786261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.786540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.786811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] PATH_INFO: `/v3/users/b0a62e928e2f478f87d9c714790145c5` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.787959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] RBAC: Authorizing `identity:get_user(user_id=b0a62e928e2f478f87d9c714790145c5)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:22.789452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:22.791030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 100/193] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/users/b0a62e928e2f478f87d9c714790145c5 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:22.791777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:22.859072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.869188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:22.882658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf617-48e1-4ae6-b347-9ecad3b4f898 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.902963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17cea-2a28-4956-8953-2a93063dab7a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:22.918767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.919472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.919671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.919948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.941701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:22.942730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:22.943027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:22.943290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:22.943938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:22.945536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:22.968850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 101/194] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:41:22 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:22.969673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:23.006125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:23.008359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:23.118928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:23.121857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a35cfb-83db-43dd-ac59-28064e9118cb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:23.153904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:23.154446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 94/195] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:23.160778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:23.164910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:23.165676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:23.165676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:23.165860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:23.261503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:23.263419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:23.282292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599ff01-c3e4-4cec-b9b9-4185712cf059 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:23.334343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:23.334702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:23.334976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:23.335239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:23.336469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:23.338149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:23.339965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 95/196] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:23 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:23.345614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:23.398373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 102/197] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:23.403980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:23.423134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:23.436850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:23.497003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7e565-1c47-4f36-849d-c32b29798ee5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:23.536503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:23.537120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:23.537540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:23.537818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:23.538620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=b0a62e928e2f478f87d9c714790145c5) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:23.538933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:23.540372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:23.546892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 96/198] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:23 2022] GET /identity/v3/role_assignments?user.id=b0a62e928e2f478f87d9c714790145c5&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:23.574700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c10f8-919c-4eeb-b22b-f3bfcf002dfd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:23.619164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cba1cd-497d-43f7-8903-c9a6337a18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:23.619838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba1cd-497d-43f7-8903-c9a6337a18a3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:23.620119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba1cd-497d-43f7-8903-c9a6337a18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:23.620411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba1cd-497d-43f7-8903-c9a6337a18a3 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:23.625339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cba1cd-497d-43f7-8903-c9a6337a18a3 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:23.626868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cba1cd-497d-43f7-8903-c9a6337a18a3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:23.629267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 103/199] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:23 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:23.635490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:23.776596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedb871-e17a-4a8f-a7e7-bac38ed66836 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:23.792291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:23.816679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:23.817298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:23.817583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:23.817859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:23.818361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1280d-98c3-4dd8-9971-016ba33b372c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:23.818645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1280d-98c3-4dd8-9971-016ba33b372c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:23.818809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] RBAC: Adding query filter params (role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=b0a62e928e2f478f87d9c714790145c5) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:23.818954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1280d-98c3-4dd8-9971-016ba33b372c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:23.819094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:23.820417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:23.821655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 104/200] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:23.825819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fea92f-2616-470a-a714-c26e8a5f876e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:23.826104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fea92f-2616-470a-a714-c26e8a5f876e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:23.826382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fea92f-2616-470a-a714-c26e8a5f876e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:23.826865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 97/201] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:23 2022] GET /identity/v3/role_assignments?user.id=b0a62e928e2f478f87d9c714790145c5&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:23.862934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-65fea92f-2616-470a-a714-c26e8a5f876e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:23.864169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-65fea92f-2616-470a-a714-c26e8a5f876e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:23.973836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 105/202] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:24.312891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:24.436792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c604c7a-ec2a-47b2-832e-2b6bfc520f1e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:24.480018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:24.480699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:24.480982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:24.481258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:24.497831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:24.503587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:24.505653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:24.507559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 98/203] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:24.512415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fea92f-2616-470a-a714-c26e8a5f876e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:24.568937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:24.670808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fea92f-2616-470a-a714-c26e8a5f876e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:24.713818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:24.714437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:24.714715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:24.714990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:24.715670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:24.715977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:24.717479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:24.730268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 106/204] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:24.735601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:24.790402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:24.874005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ec437-41e0-400e-8492-2e27c33fc9dd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:24.917859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:24.918500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:24.918782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:24.919059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] PATH_INFO: `/v3/users/5068a1a96fe94e3091738d3b0d908673` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:24.921137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] RBAC: Authorizing `identity:get_user(user_id=5068a1a96fe94e3091738d3b0d908673)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:24.922607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:24.924270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 99/205] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:24 2022] GET /identity/v3/users/5068a1a96fe94e3091738d3b0d908673 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:24.929994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:25.070973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:25.086574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b28ae-d87f-41ba-9add-b46b1a088d06 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:25.125788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:25.126333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:25.126617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:25.126888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:25.224765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:25.226257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:25.329742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:25.342768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 107/206] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:25.349052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:25.465758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a99b6-2f3d-43d9-bd24-2000cefc640e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:25.468182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:25.506172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c67d9-2983-4654-8d62-666d90461b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:25.506812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c67d9-2983-4654-8d62-666d90461b5f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:25.507093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c67d9-2983-4654-8d62-666d90461b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:25.507365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c67d9-2983-4654-8d62-666d90461b5f None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:25.509054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c67d9-2983-4654-8d62-666d90461b5f None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:25.510536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c67d9-2983-4654-8d62-666d90461b5f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:25.516480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 100/207] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:25 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:25.518943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:25.686416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6355ba-33a7-4fad-be48-b4acb8566d90 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:25.742379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad6b6b-8aa0-4bee-8e84-7497974eeef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:25.742913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6b6b-8aa0-4bee-8e84-7497974eeef5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:25.743194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6b6b-8aa0-4bee-8e84-7497974eeef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:25.743466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad6b6b-8aa0-4bee-8e84-7497974eeef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:25.744294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad6b6b-8aa0-4bee-8e84-7497974eeef5 None admin] RBAC: Adding query filter params (role.id=ebdde59a9acf4f6aab6348992db4ade2, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f, user.id=5068a1a96fe94e3091738d3b0d908673) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:25.744629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad6b6b-8aa0-4bee-8e84-7497974eeef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:25.746089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad6b6b-8aa0-4bee-8e84-7497974eeef5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:25.757864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 108/208] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:25 2022] GET /identity/v3/role_assignments?user.id=5068a1a96fe94e3091738d3b0d908673&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=ebdde59a9acf4f6aab6348992db4ade2 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:25.802749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4441c29-65c8-47bc-bbe6-95921eebff20 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:25.803419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4441c29-65c8-47bc-bbe6-95921eebff20 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:25.803998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4441c29-65c8-47bc-bbe6-95921eebff20 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:25.805690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 101/209] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:25.811714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f927f-3690-40ae-b7bc-a4d2a846444a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:25.812327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f927f-3690-40ae-b7bc-a4d2a846444a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:25.812860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f927f-3690-40ae-b7bc-a4d2a846444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:25.815657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c8031-40c0-4c04-b473-fc99ab29d7f8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:25.815958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c8031-40c0-4c04-b473-fc99ab29d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:25.816232 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c8031-40c0-4c04-b473-fc99ab29d7f8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:25.817685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 102/210] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:41:25.823410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bb0d-b961-4869-83ff-48011f07fe70 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:25.823690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bb0d-b961-4869-83ff-48011f07fe70 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:25.823979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14bb0d-b961-4869-83ff-48011f07fe70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:25.851517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e42f927f-3690-40ae-b7bc-a4d2a846444a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:25.852790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e42f927f-3690-40ae-b7bc-a4d2a846444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:25.861392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5c14bb0d-b961-4869-83ff-48011f07fe70 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:25.862717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5c14bb0d-b961-4869-83ff-48011f07fe70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:25.948100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:25.973801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 109/211] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:26.003427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 103/212] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:26.033994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6bb4f-3e16-4d70-a3cb-3c792716a4f8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.034284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6bb4f-3e16-4d70-a3cb-3c792716a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.034560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6bb4f-3e16-4d70-a3cb-3c792716a4f8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.036197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 110/213] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:26.041222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdeaac-7122-4c00-a057-59d3621b19b1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.043445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdeaac-7122-4c00-a057-59d3621b19b1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.043445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdeaac-7122-4c00-a057-59d3621b19b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.061161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cafdeaac-7122-4c00-a057-59d3621b19b1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:26.062358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cafdeaac-7122-4c00-a057-59d3621b19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:26.137006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 104/214] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:26.159842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c597ca-04de-4f9c-9acf-3d1bb52b01df None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.160440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c597ca-04de-4f9c-9acf-3d1bb52b01df None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.160921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c597ca-04de-4f9c-9acf-3d1bb52b01df None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.162709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 111/215] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:26.167606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd4792-491a-4f0b-ad94-61d07647fd59 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.167902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd4792-491a-4f0b-ad94-61d07647fd59 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.168182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd4792-491a-4f0b-ad94-61d07647fd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.190462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d2bd4792-491a-4f0b-ad94-61d07647fd59 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:26.191660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d2bd4792-491a-4f0b-ad94-61d07647fd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:26.219021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:26.260275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c597ca-04de-4f9c-9acf-3d1bb52b01df None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.262216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 105/216] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:26.315512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd4792-491a-4f0b-ad94-61d07647fd59 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.367974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c597ca-04de-4f9c-9acf-3d1bb52b01df None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.405531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.406417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.407128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.407549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.419227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:26.419864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd4792-491a-4f0b-ad94-61d07647fd59 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:26.424972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:26.426065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:26.426971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:26.428785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 112/217] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:41:26.429720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.458899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.459651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.459929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.460379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.461484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:26.462927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:26.464716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 106/218] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:26.465285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.476245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:26.496032 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:26.543474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd2098-d50d-4650-a5e9-691604450c09 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.568996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b48db-99a4-48f6-96b6-438f1853634d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.582183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.582831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.583112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.583383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.597149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:26.601915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:26.602765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:26.603564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 113/219] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:26.604222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.608853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.608853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.608853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.609172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.609670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:26.609974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:26.611373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:26.624042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 107/220] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:26.624042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.711654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:26.713721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3503a10-e799-4f06-842b-328b2b3435e4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.715420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:26.722428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d692891-d09f-46e9-a73f-eb9071c6d6cf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.752352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.753494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.753775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.754049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.754693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:26.755568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.756161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:26.756251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.756521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.756798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.766893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:26.774039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:26.775055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:26.775847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:26.777869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 114/221] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:41:26 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:26.778698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.780192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 108/222] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:26.781116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.898709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640069-29a3-46b3-b863-f980d4fe0265 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.898907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8388186-b59a-4101-89e9-e456c4699b88 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:26.940065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.940502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:26.940942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.941139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:26.941249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.941421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:26.941511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] PATH_INFO: `/v3/users/e2e21941a65240a69c074aa0242e4e0d` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.941652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:26.942322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:26.942631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:26.944067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:26.953418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 115/223] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:26.954024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.962069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e21941a65240a69c074aa0242e4e0d)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:26.963533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:26.965392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 109/224] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/users/e2e21941a65240a69c074aa0242e4e0d => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:26.966025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:26.979019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:26.979918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:27.082668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fa0e7-7482-4226-b676-2a22fd487db8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.101936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e614b8-16ea-4c89-a8f3-15b8592022c9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.125202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.125824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.126104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.126378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.127053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:27.127360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.128871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.137289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 116/225] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:27.137948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.146982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.147870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.148302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.148796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] PATH_INFO: `/v3/users/b0a62e928e2f478f87d9c714790145c5` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.150111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a62e928e2f478f87d9c714790145c5)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.151719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.153537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 110/226] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:26 2022] GET /identity/v3/users/b0a62e928e2f478f87d9c714790145c5 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:27.154682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.249706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:27.256314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:27.278725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914e2f-b393-4f0b-9799-8448a3af8218 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.283135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd26a0-ac1d-4109-a351-aa92114a39b8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.322421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.323667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.324094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.324550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] PATH_INFO: `/v3/users/b0a62e928e2f478f87d9c714790145c5` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.325955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] RBAC: Authorizing `identity:get_user(user_id=b0a62e928e2f478f87d9c714790145c5)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.327286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.327796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.328122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.328530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.328905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.330164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 111/227] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:27 2022] GET /identity/v3/users/b0a62e928e2f478f87d9c714790145c5 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:27.335447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.415118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.416653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.454468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a91671-17a4-4c20-a693-439153ffc8fb None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.494478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.495146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.495429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.495707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.496939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.498426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.500175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 112/228] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:27 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:27.500993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.515627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:27.518471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:27.539381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 117/229] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:27.540219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.628551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba178b86-0d8e-4464-8dcf-5b3bb890cf23 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.665043 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0ae28-634e-4661-8208-58093f5de972 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.671415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.672108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.672537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.672913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.674188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.676666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.678545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 113/230] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:27 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:27.679457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.702905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.703565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.703840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.704106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/b0a62e928e2f478f87d9c714790145c5/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.706603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] RBAC: Authorizing `identity:create_grant(project_id=77a19a4d5b8742af8c2028ccba21a2db, user_id=b0a62e928e2f478f87d9c714790145c5, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.708036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.721255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 118/231] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:27 2022] PUT /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/b0a62e928e2f478f87d9c714790145c5/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:27.722240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.772328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:27.777223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:27.815781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b4b8d-d924-415e-b275-bdacae0cf76c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.838933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5b71c-0781-41b9-9140-1271e9c0bd28 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:27.887574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d4cb9-da00-4850-b3d0-d540d6eb2d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.888538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4cb9-da00-4850-b3d0-d540d6eb2d94 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.888817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4cb9-da00-4850-b3d0-d540d6eb2d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.889090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4cb9-da00-4850-b3d0-d540d6eb2d94 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/b0a62e928e2f478f87d9c714790145c5/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.890268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:27.890906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:27.891177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:27.891444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:27.893077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.895977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.897699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 114/232] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:27 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:27.898690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4cb9-da00-4850-b3d0-d540d6eb2d94 None admin] RBAC: Authorizing `identity:create_grant(project_id=77a19a4d5b8742af8c2028ccba21a2db, user_id=b0a62e928e2f478f87d9c714790145c5, role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:27.900193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4cb9-da00-4850-b3d0-d540d6eb2d94 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:27.903677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:27.921851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 119/233] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:27 2022] PUT /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/b0a62e928e2f478f87d9c714790145c5/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:28.038455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece966d7-ed24-40f9-8b5a-e5e8cd0e35e9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:28.077912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2b85-ac39-44d3-a68b-af57175f3926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:28.078541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2b85-ac39-44d3-a68b-af57175f3926 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:28.078889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2b85-ac39-44d3-a68b-af57175f3926 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:28.079168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2b85-ac39-44d3-a68b-af57175f3926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:28.079971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2b85-ac39-44d3-a68b-af57175f3926 None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=e2e21941a65240a69c074aa0242e4e0d) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:28.080288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2b85-ac39-44d3-a68b-af57175f3926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:28.081844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c2b85-ac39-44d3-a68b-af57175f3926 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:28.088454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 115/234] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:27 2022] GET /identity/v3/role_assignments?user.id=e2e21941a65240a69c074aa0242e4e0d&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:29.146087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b645e-962e-4720-90b5-ab9fb9779881 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:29.146620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b645e-962e-4720-90b5-ab9fb9779881 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:29.146620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b645e-962e-4720-90b5-ab9fb9779881 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:29.148214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 120/235] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:29.154001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6db01-4fa8-4b22-94e1-3345893742d8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:29.154446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6db01-4fa8-4b22-94e1-3345893742d8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:29.154624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6db01-4fa8-4b22-94e1-3345893742d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:29.179791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c2a6db01-4fa8-4b22-94e1-3345893742d8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:29.181043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c2a6db01-4fa8-4b22-94e1-3345893742d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:29.191097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:29.194637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcb414-8bcf-48a8-bd73-2ca143e329a8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:29.194923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcb414-8bcf-48a8-bd73-2ca143e329a8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:29.195198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcb414-8bcf-48a8-bd73-2ca143e329a8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:29.197098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 121/236] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:29.202576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f3af-9135-4453-ab92-b8243360ccf7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:29.202870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f3af-9135-4453-ab92-b8243360ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:29.203149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f3af-9135-4453-ab92-b8243360ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:29.236308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3432f3af-9135-4453-ab92-b8243360ccf7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:29.238107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3432f3af-9135-4453-ab92-b8243360ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:29.281656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 116/237] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:29.380317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 122/238] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:29.607157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6db01-4fa8-4b22-94e1-3345893742d8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:29.711287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6db01-4fa8-4b22-94e1-3345893742d8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:29.746563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:29.747201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:29.747543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:29.747819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:29.758807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:29.763944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:29.764853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:29.765629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 117/239] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:29.771210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f3af-9135-4453-ab92-b8243360ccf7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:29.804398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:29.863928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:29.870937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:29.895706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f3af-9135-4453-ab92-b8243360ccf7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:29.946302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:29.946985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:29.947410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:29.947697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:29.949756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:29.950088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:29.951666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:29.970253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 123/240] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:29.978673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:30.035848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddf25-7222-458c-9750-3d74b35dd300 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:30.101227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:30.101880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.102166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.102441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.105083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:30.106559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:30.108650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 118/241] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:30.126135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:30.165603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:30.174395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41038d48-9e09-4995-8cdc-9c1ba56e7b93 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:30.246333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052f4ed-eeee-481f-b657-d7f94ca66f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:30.248077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f4ed-eeee-481f-b657-d7f94ca66f5a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.249232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f4ed-eeee-481f-b657-d7f94ca66f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.249711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052f4ed-eeee-481f-b657-d7f94ca66f5a None admin] PATH_INFO: `/v3/users/e02511f06bd74985b6a652e89d996561` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.289188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:30.307824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f4ed-eeee-481f-b657-d7f94ca66f5a None admin] RBAC: Authorizing `identity:get_user(user_id=e02511f06bd74985b6a652e89d996561)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:30.309340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052f4ed-eeee-481f-b657-d7f94ca66f5a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:30.311868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 124/242] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:29 2022] GET /identity/v3/users/e02511f06bd74985b6a652e89d996561 => generated 297 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:30.313903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93f941-ee74-45ad-a6f7-2c551caa4a55 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.314183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93f941-ee74-45ad-a6f7-2c551caa4a55 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.314457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93f941-ee74-45ad-a6f7-2c551caa4a55 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.319229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 125/243] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:30.320179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93f941-ee74-45ad-a6f7-2c551caa4a55 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:30.358983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac4ab7-7c33-4e5c-8a2e-0b4c9d68b07f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:30.415438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc006bdc-a082-411c-a926-b3c328e92539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:30.416055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc006bdc-a082-411c-a926-b3c328e92539 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.416341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc006bdc-a082-411c-a926-b3c328e92539 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.416648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc006bdc-a082-411c-a926-b3c328e92539 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.417299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc006bdc-a082-411c-a926-b3c328e92539 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:30.418723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc006bdc-a082-411c-a926-b3c328e92539 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:30.446235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 119/244] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:41:30 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:30.447583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29868f5-f301-434d-b0d0-808dd36353cb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.447941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29868f5-f301-434d-b0d0-808dd36353cb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.448229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29868f5-f301-434d-b0d0-808dd36353cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.467893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d29868f5-f301-434d-b0d0-808dd36353cb None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:30.469315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d29868f5-f301-434d-b0d0-808dd36353cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:30.472536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93f941-ee74-45ad-a6f7-2c551caa4a55 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:30.521374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:30.522353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.522638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.522911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.552320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:30.567197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 120/245] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:30.567197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cfa1c-0437-40c7-860c-7146a2d23dc2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.567197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cfa1c-0437-40c7-860c-7146a2d23dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.567197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cfa1c-0437-40c7-860c-7146a2d23dc2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.567197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 121/246] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:30.567197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a08bc-6620-4fc6-b38c-94abb48c3c9a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.567197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a08bc-6620-4fc6-b38c-94abb48c3c9a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.567756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a08bc-6620-4fc6-b38c-94abb48c3c9a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.572475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 122/247] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:30.574221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd8d8-385a-4bbb-8797-890f569e5d83 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.574517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd8d8-385a-4bbb-8797-890f569e5d83 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.574793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467cd8d8-385a-4bbb-8797-890f569e5d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.599598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-467cd8d8-385a-4bbb-8797-890f569e5d83 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:30.600905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-467cd8d8-385a-4bbb-8797-890f569e5d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:30.624736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:30.627092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:30.679661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:30.709500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 123/248] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:30.710768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7f2f5-ef19-49c5-be07-ee931883d0ef None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.711055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7f2f5-ef19-49c5-be07-ee931883d0ef None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.711327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7f2f5-ef19-49c5-be07-ee931883d0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.731936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6ca7f2f5-ef19-49c5-be07-ee931883d0ef None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:30.733934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6ca7f2f5-ef19-49c5-be07-ee931883d0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:30.769882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 126/249] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:30.775304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:30.820982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 124/250] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:30.841607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:30.889250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7f2f5-ef19-49c5-be07-ee931883d0ef None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:30.895555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933e9b9-5e1b-484e-b9bc-fd1312bb9591 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:30.933111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:30.933669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:30.933946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:30.934216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:30.935857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:30.937412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:30.939342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 127/251] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:30 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:30.945764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.023172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7f2f5-ef19-49c5-be07-ee931883d0ef None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.048778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:31.063585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.064370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.065040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.065924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.074643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e15f5f-2010-42ab-aebf-672f25d44648 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.079577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:31.085634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:31.086517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:31.087326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 125/252] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:41:31.088148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.106213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:31.122065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.123027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.123487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.123936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.124920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] RBAC: Adding query filter params (role.id=ebdde59a9acf4f6aab6348992db4ade2, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=e02511f06bd74985b6a652e89d996561) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:31.125423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:31.127154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:31.139257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 128/253] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:30 2022] GET /identity/v3/role_assignments?user.id=e02511f06bd74985b6a652e89d996561&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=ebdde59a9acf4f6aab6348992db4ade2 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:31.140312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.261814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c78ef8-7142-468f-a633-8394a5a8ed29 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.331885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.332647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.332812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.333087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.346140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235f2f-35cb-4427-8700-caf835674fbb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.359829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:31.365155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:31.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:31.366858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 126/254] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:31.368295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.407183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.407806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.408086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.408360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.409131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:31.411354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:31.412834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:31.427060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 129/255] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:31.428309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.448786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:31.524223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:31.553764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c57ab-3366-40c6-a62e-2a30f44c809a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.588436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85520e-248b-48ac-b16b-9536492e7c8f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.633596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.634475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.635273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.636047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.636707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.636927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.637340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.637763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.638909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:31.639844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:31.641585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:31.660072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:31.664994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 130/256] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:31.665965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:31.667898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:31.668993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:31.669977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:31.680716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 127/257] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:31.681974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.777984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57f50e-de48-4673-9bd4-65df088c784f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.788716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:31.826114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.827109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.827598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.828098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] PATH_INFO: `/v3/users/b0a62e928e2f478f87d9c714790145c5` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.833549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] RBAC: Authorizing `identity:get_user(user_id=b0a62e928e2f478f87d9c714790145c5)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:31.835478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:31.838069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 131/258] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/users/b0a62e928e2f478f87d9c714790145c5 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:31.838989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:31.856725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:31.861472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b7b49-38ec-43e4-87f6-206d69e65e69 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:31.930274 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:31.930924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:31.931205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:31.931518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] PATH_INFO: `/v3/users/b0a62e928e2f478f87d9c714790145c5` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:31.934495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] RBAC: Authorizing `identity:get_user(user_id=b0a62e928e2f478f87d9c714790145c5)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:31.937470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:31.941451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 128/259] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/users/b0a62e928e2f478f87d9c714790145c5 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:31.942500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:32.001362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92938bbc-14dd-46b4-b635-12e0dac5717c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:32.045559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:32.046155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:32.046445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:32.046722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:32.047405 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:32.047710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:32.049178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:32.058394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 132/260] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:32.059218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:32.133924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59684579-900b-4b34-bd6d-2b1364812b35 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:32.142381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:32.210686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:32.211372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:32.211655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:32.211933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:32.241500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca822c6-17aa-432f-a440-4c6dedbf6bad None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:32.274688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:32.311028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:32.311569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:32.311853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:32.312131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:32.344339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:32.346022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:32.454623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:32.456854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:32.508688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 129/261] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:32.508688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:32.550522 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:32.583682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:32.617983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c1419-d776-41e4-adca-e0c6a175324d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:32.655076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:32.656037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:32.656549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:32.657019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] PATH_INFO: `/v3/users/e2e21941a65240a69c074aa0242e4e0d` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:32.659667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e21941a65240a69c074aa0242e4e0d)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:32.661368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:32.663158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 130/262] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:32 2022] GET /identity/v3/users/e2e21941a65240a69c074aa0242e4e0d => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:32.664128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:32.738984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 133/263] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:32.739909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:32.773268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e60828-aa0e-4185-99e3-d01825521475 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:32.810190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:32.811198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:32.811672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:32.812271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:32.813684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:32.815830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:32.818405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 131/264] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:32 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:32.819384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:32.822476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:32.925412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e3ff-feb4-4788-976c-58cc74f934b7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:32.963711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:32.964724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:32.965218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:32.965850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:32.967179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:32.968967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:32.971100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 132/265] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:32 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:32.972159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:33.032147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9762506-1306-42c6-93b6-f85ae671f7bb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:33.066159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:33.071049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:33.072029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.072029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.072403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.074172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:33.075683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:33.077541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 134/266] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:32 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:33.078149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:33.087621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:33.099669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d485775-6b9e-45de-a9f9-c00c009faa20 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:33.134966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d41c0-fcba-4fc3-ba15-9ebadda3ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:33.135582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d41c0-fcba-4fc3-ba15-9ebadda3ba30 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.135863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d41c0-fcba-4fc3-ba15-9ebadda3ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.136130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d41c0-fcba-4fc3-ba15-9ebadda3ba30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.136894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d41c0-fcba-4fc3-ba15-9ebadda3ba30 None admin] RBAC: Adding query filter params (role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=b0a62e928e2f478f87d9c714790145c5) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:33.137200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d41c0-fcba-4fc3-ba15-9ebadda3ba30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:33.138878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d41c0-fcba-4fc3-ba15-9ebadda3ba30 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:33.145169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 133/267] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:32 2022] GET /identity/v3/role_assignments?user.id=b0a62e928e2f478f87d9c714790145c5&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:33.146312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea8ae-3be2-4e83-aa2f-d25a563e34a2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.146596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea8ae-3be2-4e83-aa2f-d25a563e34a2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.146868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea8ae-3be2-4e83-aa2f-d25a563e34a2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.148053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 134/268] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:33.148774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ea8ae-3be2-4e83-aa2f-d25a563e34a2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:33.223852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a06375-bbb5-42d0-b9aa-02296ca825b0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:33.261809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff17c99-6c77-4328-852f-a1593a4facbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:33.262431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17c99-6c77-4328-852f-a1593a4facbd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.262708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17c99-6c77-4328-852f-a1593a4facbd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.262983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff17c99-6c77-4328-852f-a1593a4facbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.263984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17c99-6c77-4328-852f-a1593a4facbd None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=b0a62e928e2f478f87d9c714790145c5) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:33.264288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17c99-6c77-4328-852f-a1593a4facbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:33.265791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff17c99-6c77-4328-852f-a1593a4facbd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:33.273307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 135/269] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:33 2022] GET /identity/v3/role_assignments?user.id=b0a62e928e2f478f87d9c714790145c5&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:33.274455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cdea5-a299-4520-8396-07c873ab0422 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.274742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cdea5-a299-4520-8396-07c873ab0422 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.275013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cdea5-a299-4520-8396-07c873ab0422 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.276288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 136/270] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:33.277530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692b1a4-76c7-4bc1-96ed-4f7c88478f2c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.277807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692b1a4-76c7-4bc1-96ed-4f7c88478f2c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.278079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692b1a4-76c7-4bc1-96ed-4f7c88478f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.298816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ea8ae-3be2-4e83-aa2f-d25a563e34a2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:33.308271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6692b1a4-76c7-4bc1-96ed-4f7c88478f2c None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:33.310319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6692b1a4-76c7-4bc1-96ed-4f7c88478f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:33.341624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5076f1-a0be-445f-a6ea-e9d53751185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:33.342579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5076f1-a0be-445f-a6ea-e9d53751185a None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.342868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5076f1-a0be-445f-a6ea-e9d53751185a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.343420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5076f1-a0be-445f-a6ea-e9d53751185a None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/e2e21941a65240a69c074aa0242e4e0d/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.347191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5076f1-a0be-445f-a6ea-e9d53751185a None admin] RBAC: Authorizing `identity:create_grant(project_id=77a19a4d5b8742af8c2028ccba21a2db, user_id=e2e21941a65240a69c074aa0242e4e0d, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:33.348853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5076f1-a0be-445f-a6ea-e9d53751185a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:33.356798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:33.374700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 135/271] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:33 2022] PUT /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/e2e21941a65240a69c074aa0242e4e0d/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:33.376045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd542-67d7-416c-a3eb-9ed972dc1749 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.376339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd542-67d7-416c-a3eb-9ed972dc1749 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.376669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd542-67d7-416c-a3eb-9ed972dc1749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.390584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:33.397345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 137/272] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:33.403692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bf3bd542-67d7-416c-a3eb-9ed972dc1749 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:33.405290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bf3bd542-67d7-416c-a3eb-9ed972dc1749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:33.411229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e353-de4c-4157-8d76-87ea314edc52 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.411494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e353-de4c-4157-8d76-87ea314edc52 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.411777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e353-de4c-4157-8d76-87ea314edc52 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.413823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 138/273] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:33.420062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac5741-756b-4ce5-a3a4-b0860e0a136d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.420341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac5741-756b-4ce5-a3a4-b0860e0a136d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.421224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac5741-756b-4ce5-a3a4-b0860e0a136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.461574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4eac5741-756b-4ce5-a3a4-b0860e0a136d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:33.463456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4eac5741-756b-4ce5-a3a4-b0860e0a136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:33.503528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 136/274] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:33.570689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 139/275] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:33.747639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bd542-67d7-416c-a3eb-9ed972dc1749 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:33.801600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac5741-756b-4ce5-a3a4-b0860e0a136d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:33.863806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bd542-67d7-416c-a3eb-9ed972dc1749 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:33.888254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:33.903250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:33.903887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.904169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.904475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.915436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:33.920119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:33.921049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:33.921846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 137/276] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:33.922579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:33.929653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac5741-756b-4ce5-a3a4-b0860e0a136d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:33.960502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:33.966827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:33.967392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:33.967672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:33.967942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:33.969420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:33.970562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:33.972881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 140/277] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:33.977852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.035274 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46cbd9-e9a6-4713-8650-a1c0e2ede588 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.072364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.072945 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.073252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.073535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.083060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594fb1d-d587-47b9-98b1-667dde75fe05 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.084109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:34.088901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:34.089795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:34.090587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 138/278] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:34.091249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.130610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.131600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.132094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.132983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.133863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:34.134312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.136559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.138911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:34.148311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 141/279] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:34.149415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.199446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01fd46-0fdc-4a98-89bd-7a385624619b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.216171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:34.235980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.236667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.236884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.237180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.237813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.239390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.262482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353667a-7e74-4ad3-925a-3ea144b8b33e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.276756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 139/280] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:41:34 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:34.276756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.299864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.300518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.300807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.301083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.301771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:34.302079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.303789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.315715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 142/281] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:34.322815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.403144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:34.407285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c90bee-6090-4b66-8f69-8e605e078246 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.449863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.450615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.450901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.451180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] PATH_INFO: `/v3/users/bfd2f5cd13854cacb5dd71d40cb80367` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.452652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d8492-ffe9-4783-8617-99e69be9a0a2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.465351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] RBAC: Authorizing `identity:get_user(user_id=bfd2f5cd13854cacb5dd71d40cb80367)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.466837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.469457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 140/282] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:34 2022] GET /identity/v3/users/bfd2f5cd13854cacb5dd71d40cb80367 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:34.475129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.480790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:34.496259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.497388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.497724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.498248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] PATH_INFO: `/v3/users/e02511f06bd74985b6a652e89d996561` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.499887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] RBAC: Authorizing `identity:get_user(user_id=e02511f06bd74985b6a652e89d996561)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.501520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.504983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 143/283] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:34 2022] GET /identity/v3/users/e02511f06bd74985b6a652e89d996561 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:34.511817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.606752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffc33-d339-4f29-9207-33bc57800d96 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.655735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.656508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.656796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.657078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.657838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, user.id=bfd2f5cd13854cacb5dd71d40cb80367, scope.system=all) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:34.658145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.660162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.666916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 141/284] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 08:41:34 2022] GET /identity/v3/role_assignments?user.id=bfd2f5cd13854cacb5dd71d40cb80367&scope.system=all&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:34.674562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6668c5-4a20-431d-9cb5-d78f745d0df3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.724759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88cd78-8f47-4384-a0f4-67d26f22489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.725803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88cd78-8f47-4384-a0f4-67d26f22489c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.726289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88cd78-8f47-4384-a0f4-67d26f22489c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.726790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88cd78-8f47-4384-a0f4-67d26f22489c None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.733377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88cd78-8f47-4384-a0f4-67d26f22489c None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.735215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88cd78-8f47-4384-a0f4-67d26f22489c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.737897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 144/285] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:34 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:34.743779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:34.792408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:34.887044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32923c3-1037-498a-8731-f3a465ac4f58 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:34.923409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cb5b0-ddb7-4628-87f3-9647a4b1555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:34.924134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cb5b0-ddb7-4628-87f3-9647a4b1555d None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:34.924470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cb5b0-ddb7-4628-87f3-9647a4b1555d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:34.924792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cb5b0-ddb7-4628-87f3-9647a4b1555d None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/e02511f06bd74985b6a652e89d996561/roles/ebdde59a9acf4f6aab6348992db4ade2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:34.926748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cb5b0-ddb7-4628-87f3-9647a4b1555d None admin] RBAC: Authorizing `identity:create_grant(project_id=77a19a4d5b8742af8c2028ccba21a2db, user_id=e02511f06bd74985b6a652e89d996561, role_id=ebdde59a9acf4f6aab6348992db4ade2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:34.928192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cb5b0-ddb7-4628-87f3-9647a4b1555d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:34.948811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 142/286] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:41:34 2022] PUT /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/users/e02511f06bd74985b6a652e89d996561/roles/ebdde59a9acf4f6aab6348992db4ade2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:35.536664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b889b-f33b-432a-a269-910feaf83eee None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:35.537733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b889b-f33b-432a-a269-910feaf83eee None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:35.538221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b889b-f33b-432a-a269-910feaf83eee None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:35.539768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 145/287] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:35.545319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638efe-822b-493f-91e2-88b888b4c5db None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:35.545722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638efe-822b-493f-91e2-88b888b4c5db None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:35.545914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42638efe-822b-493f-91e2-88b888b4c5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:35.569980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-42638efe-822b-493f-91e2-88b888b4c5db None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:35.571169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-42638efe-822b-493f-91e2-88b888b4c5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:35.674078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 143/288] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:35.999274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b889b-f33b-432a-a269-910feaf83eee None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:36.080413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:36.126647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b889b-f33b-432a-a269-910feaf83eee None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:36.163407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:36.164047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:36.164328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:36.164632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:36.179085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:36.184473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:36.185355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:36.186124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 146/289] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:36.191937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638efe-822b-493f-91e2-88b888b4c5db None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:36.206495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:36.318662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42638efe-822b-493f-91e2-88b888b4c5db None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:36.373128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:36.373764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:36.374047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:36.374325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:36.375012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:36.375320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:36.376724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:36.386279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 144/290] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:36.392179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:36.513020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95ea6b-1aa8-4d4a-aff1-f89b928468ca None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:36.531145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:36.549902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c97e4-a307-4d95-833d-ff8c4c921df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:36.550556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c97e4-a307-4d95-833d-ff8c4c921df8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:36.550802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c97e4-a307-4d95-833d-ff8c4c921df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:36.551076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c97e4-a307-4d95-833d-ff8c4c921df8 None admin] PATH_INFO: `/v3/users/e2e21941a65240a69c074aa0242e4e0d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:36.552466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c97e4-a307-4d95-833d-ff8c4c921df8 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e21941a65240a69c074aa0242e4e0d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:36.553932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c97e4-a307-4d95-833d-ff8c4c921df8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:36.555677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 147/291] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:36 2022] GET /identity/v3/users/e2e21941a65240a69c074aa0242e4e0d => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:36.561273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:36.642612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:36.669471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bdf7e-fab3-436f-8439-664b96c99f85 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:36.717006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:36.717624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:36.717908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:36.718187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:36.795434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:36.796946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:36.878441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:36.913589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fa272-b77c-4de6-a2ef-076bdff95dec None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:36.913894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fa272-b77c-4de6-a2ef-076bdff95dec None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:36.914147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fa272-b77c-4de6-a2ef-076bdff95dec None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:36.915481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 148/293] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:36.915611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 145/293] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:36.920759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367517-ceff-4a6e-bff8-ee18e51fe498 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:36.921047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367517-ceff-4a6e-bff8-ee18e51fe498 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:36.921320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf367517-ceff-4a6e-bff8-ee18e51fe498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:36.925968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:36.952634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cf367517-ceff-4a6e-bff8-ee18e51fe498 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:36.953986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cf367517-ceff-4a6e-bff8-ee18e51fe498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:37.067789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0e3a9-0f35-4c69-9876-c20ce4615639 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:37.068837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 149/294] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:37.071319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b89bf-ecb2-4dfa-9fc7-c76a07684287 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.071779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b89bf-ecb2-4dfa-9fc7-c76a07684287 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.072198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b89bf-ecb2-4dfa-9fc7-c76a07684287 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.073708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 150/295] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:37.081420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc5dd-1a24-4324-89bd-fc7de6d69b05 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.081982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc5dd-1a24-4324-89bd-fc7de6d69b05 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.082451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbc5dd-1a24-4324-89bd-fc7de6d69b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.103133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-67cbc5dd-1a24-4324-89bd-fc7de6d69b05 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:37.104736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-67cbc5dd-1a24-4324-89bd-fc7de6d69b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:37.105829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:37.106472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.106755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.107029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.108188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:37.109652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:37.111573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 146/296] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:36 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:37.120295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:37.204533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:37.211439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 151/297] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:37.217688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301591ea-be5a-4933-ba2e-863077f0ecfd None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.218294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301591ea-be5a-4933-ba2e-863077f0ecfd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.218754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301591ea-be5a-4933-ba2e-863077f0ecfd None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.220246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 152/298] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:37.226496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba97a-4141-4e63-a9ee-c02c8d8ab3be None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.227033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba97a-4141-4e63-a9ee-c02c8d8ab3be None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.227485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba97a-4141-4e63-a9ee-c02c8d8ab3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.250703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6a7ba97a-4141-4e63-a9ee-c02c8d8ab3be None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:37.252002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6a7ba97a-4141-4e63-a9ee-c02c8d8ab3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:37.309727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ade45-d5d6-4293-899c-53dd875ab98d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:37.310674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:37.360677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:37.361532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.362922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.363343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.364252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=e2e21941a65240a69c074aa0242e4e0d) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:37.366857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 153/299] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:37.367102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:37.368948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:37.375601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 147/300] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:37 2022] GET /identity/v3/role_assignments?user.id=e2e21941a65240a69c074aa0242e4e0d&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:37.414857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ba97a-4141-4e63-a9ee-c02c8d8ab3be None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:37.521774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:37.531496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ba97a-4141-4e63-a9ee-c02c8d8ab3be None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:37.570535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:37.571922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.572401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.572840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.574225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:37.575961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:37.577886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 154/301] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:37.584375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:37.638894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:37.670937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a869a-716c-4e6c-8103-81ac132d2c0f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:37.679654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:37.705628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70dda2-a4d4-4ddc-a7ee-92efc01198d3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:37.708613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152f76e-7825-4fb5-8479-039eddf812a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:37.709481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f76e-7825-4fb5-8479-039eddf812a9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.709970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f76e-7825-4fb5-8479-039eddf812a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.710442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152f76e-7825-4fb5-8479-039eddf812a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.722166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152f76e-7825-4fb5-8479-039eddf812a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8152f76e-7825-4fb5-8479-039eddf812a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:37.728591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:37.729489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:37.730298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:37.730888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 148/302] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:41:37.731971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7815-4469-4c49-a7d1-9f439183d090 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.732261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7815-4469-4c49-a7d1-9f439183d090 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.732600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7815-4469-4c49-a7d1-9f439183d090 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.734639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 149/303] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:37.735495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7815-4469-4c49-a7d1-9f439183d090 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:37.750333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:37.750969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.751252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.751531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] PATH_INFO: `/v3/groups` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.752177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:37.754208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:37.772455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 155/304] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 24 08:41:37 2022] POST /identity/v3/groups => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:41:37.773232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:37.859267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7815-4469-4c49-a7d1-9f439183d090 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:37.886439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb877-99b8-4008-826d-0940d97546a8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:37.889759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:37.904015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63ce02-8545-4c04-892b-f10ed7929dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:37.904692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ce02-8545-4c04-892b-f10ed7929dde None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.904975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ce02-8545-4c04-892b-f10ed7929dde None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.905314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ce02-8545-4c04-892b-f10ed7929dde None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.916500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63ce02-8545-4c04-892b-f10ed7929dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-0e63ce02-8545-4c04-892b-f10ed7929dde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:37.921727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:37.922593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:37.923467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 150/305] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:37.924117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ad21-9331-49d1-9e5f-2761ace42b78 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.924593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ad21-9331-49d1-9e5f-2761ace42b78 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.924687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5ad21-9331-49d1-9e5f-2761ace42b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.929570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:37.930383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:37.930664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:37.930932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:37.931593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:37.931893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:37.933313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:37.943369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-41f5ad21-9331-49d1-9e5f-2761ace42b78 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:37.943818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 156/306] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:37.944596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-41f5ad21-9331-49d1-9e5f-2761ace42b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:37.944720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:37.972220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:38.028990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 151/307] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:38.029810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5ad21-9331-49d1-9e5f-2761ace42b78 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.071827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4f3b7-4182-4bce-a093-afb0d4f60cae None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.118782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.119729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.120204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.120645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.121456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:38.121901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:38.123495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:38.132345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 157/308] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:38.138958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.143873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5ad21-9331-49d1-9e5f-2761ace42b78 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.170271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:38.180552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.181949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.182233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.182510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] PATH_INFO: `/v3/users/1386adf9b7104315a11a90266652cf69` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.199817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] RBAC: Authorizing `identity:get_user(user_id=1386adf9b7104315a11a90266652cf69)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:38.201606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:38.208787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 152/309] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:38 2022] GET /identity/v3/users/1386adf9b7104315a11a90266652cf69 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:38.210258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.227095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:38.272639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc661c-8e43-454c-aeb6-792b44add012 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.310316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.310869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.311155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.311432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] PATH_INFO: `/v3/users/bfd2f5cd13854cacb5dd71d40cb80367` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.312623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] RBAC: Authorizing `identity:get_user(user_id=bfd2f5cd13854cacb5dd71d40cb80367)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:38.314068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:38.315857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 158/310] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:38 2022] GET /identity/v3/users/bfd2f5cd13854cacb5dd71d40cb80367 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:38.318126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc58a69-2ab9-4827-ab8e-e7dfd900f72b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.321016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.354375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.354982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.355260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.355529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.356255 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] RBAC: Adding query filter params (role.id=ebdde59a9acf4f6aab6348992db4ade2, user.id=1386adf9b7104315a11a90266652cf69, scope.system=all) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:38.357240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:38.358037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:38.364443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 153/311] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 08:41:38 2022] GET /identity/v3/role_assignments?user.id=1386adf9b7104315a11a90266652cf69&scope.system=all&role.id=ebdde59a9acf4f6aab6348992db4ade2 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:38.369391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.438110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:38.448363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756d1e4-eeb3-4efb-abba-bb0252e826b4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.484324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:38.491740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.492763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.493247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.493775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.506660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:38.509722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485e730-206d-4d10-bac8-829162b1f4e6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:38.512500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:38.513393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:38.514471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:38.517683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 159/312] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:38.526229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.548665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.549322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.549662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.549939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] PATH_INFO: `/v3/system/users/bfd2f5cd13854cacb5dd71d40cb80367/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.551535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bfd2f5cd13854cacb5dd71d40cb80367, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:38.553023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:38.563009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 154/313] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 24 08:41:38 2022] PUT /identity/v3/system/users/bfd2f5cd13854cacb5dd71d40cb80367/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:38.656030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb372e-fb5a-4815-8c46-ddb74f22d39a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.694391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.695400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.695876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.696342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.697302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:38.697806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:38.699415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:38.710536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 160/314] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:38.716417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.828043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b935b-b38e-4e93-ba13-745d04162071 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:38.863608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:38.864254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:38.864565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:38.864842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] PATH_INFO: `/v3/users/e02511f06bd74985b6a652e89d996561` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:38.865997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] RBAC: Authorizing `identity:get_user(user_id=e02511f06bd74985b6a652e89d996561)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:38.867454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:38.869184 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 155/315] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:38 2022] GET /identity/v3/users/e02511f06bd74985b6a652e89d996561 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:38.874972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:38.896006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:38.982512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11d0d2-9144-4a3a-bcf6-af32b440d1cc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:39.018916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:39.019885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:39.020362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:39.020849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:39.089833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:39.091638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:39.113116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:39.195681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:39.201222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:39.214808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:39.312631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752930a-ab44-4c9e-a3a6-acdf2a86f702 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:39.347339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa764a7-e588-4e3a-99aa-b13428c8f7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:39.347889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa764a7-e588-4e3a-99aa-b13428c8f7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:39.348170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa764a7-e588-4e3a-99aa-b13428c8f7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:39.348468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa764a7-e588-4e3a-99aa-b13428c8f7d6 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:39.349612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa764a7-e588-4e3a-99aa-b13428c8f7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:39.351061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa764a7-e588-4e3a-99aa-b13428c8f7d6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:39.352934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 156/317] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:39 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:39.358634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:39.458886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcd91f-4d7f-4126-9d1d-5105ea621ce7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:39.476578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:39.497967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d49ce6-cacf-4b5d-8947-76bbf2be11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:39.498987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49ce6-cacf-4b5d-8947-76bbf2be11fa None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:39.499478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49ce6-cacf-4b5d-8947-76bbf2be11fa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:39.499969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d49ce6-cacf-4b5d-8947-76bbf2be11fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:39.500962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49ce6-cacf-4b5d-8947-76bbf2be11fa None admin] RBAC: Adding query filter params (role.id=ebdde59a9acf4f6aab6348992db4ade2, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db, user.id=e02511f06bd74985b6a652e89d996561) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:39.501475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49ce6-cacf-4b5d-8947-76bbf2be11fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:39.503719 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d49ce6-cacf-4b5d-8947-76bbf2be11fa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:39.510997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 162/318] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:41:39 2022] GET /identity/v3/role_assignments?user.id=e02511f06bd74985b6a652e89d996561&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=ebdde59a9acf4f6aab6348992db4ade2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:39.765898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68115d-d4b9-4b1c-a0da-369459da4655 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:39.766413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68115d-d4b9-4b1c-a0da-369459da4655 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:39.766517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68115d-d4b9-4b1c-a0da-369459da4655 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:39.767933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 157/319] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:39.773668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc22c6-c0b3-49ea-8319-0d300a0c6a63 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:39.774035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc22c6-c0b3-49ea-8319-0d300a0c6a63 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:39.774219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc22c6-c0b3-49ea-8319-0d300a0c6a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:39.792355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-72dc22c6-c0b3-49ea-8319-0d300a0c6a63 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:39.793581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-72dc22c6-c0b3-49ea-8319-0d300a0c6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:39.861518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 163/320] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:40.135057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68115d-d4b9-4b1c-a0da-369459da4655 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:40.219102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:40.244510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68115d-d4b9-4b1c-a0da-369459da4655 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:40.278604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363036-4b1e-4921-9a7c-6613930d3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:40.279483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363036-4b1e-4921-9a7c-6613930d3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:40.279904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363036-4b1e-4921-9a7c-6613930d3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:40.280314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363036-4b1e-4921-9a7c-6613930d3cc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:40.281601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87363036-4b1e-4921-9a7c-6613930d3cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:40.283261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87363036-4b1e-4921-9a7c-6613930d3cc2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:40.285944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 158/321] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:40.291494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc22c6-c0b3-49ea-8319-0d300a0c6a63 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:40.376880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2329080-a206-4a19-9be3-923e92601cef None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:40.377199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2329080-a206-4a19-9be3-923e92601cef None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:40.377438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2329080-a206-4a19-9be3-923e92601cef None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:40.378937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 159/322] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:41:40.383511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9d5d-9500-4425-a30b-9f9c874f3683 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:40.383799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9d5d-9500-4425-a30b-9f9c874f3683 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:40.384078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b9d5d-9500-4425-a30b-9f9c874f3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:40.392577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc22c6-c0b3-49ea-8319-0d300a0c6a63 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:40.402353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bb1b9d5d-9500-4425-a30b-9f9c874f3683 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:40.403541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bb1b9d5d-9500-4425-a30b-9f9c874f3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:40.406673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:40.428994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658c0b3-7a5e-4ef6-adbf-dc2773bae9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:40.429600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c0b3-7a5e-4ef6-adbf-dc2773bae9f0 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:40.429880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c0b3-7a5e-4ef6-adbf-dc2773bae9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:40.430148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658c0b3-7a5e-4ef6-adbf-dc2773bae9f0 None admin] PATH_INFO: `/v3/groups` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:40.430760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c0b3-7a5e-4ef6-adbf-dc2773bae9f0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:40.432199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658c0b3-7a5e-4ef6-adbf-dc2773bae9f0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:40.456610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 164/323] 10.222.0.42 () {60 vars in 1134 bytes} [Wed Aug 24 08:41:40 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:41:40.478120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 160/324] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:40.606197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13389f-8e95-4b54-b7ef-a10d54fe2a1e None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:40.606517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13389f-8e95-4b54-b7ef-a10d54fe2a1e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:40.606747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13389f-8e95-4b54-b7ef-a10d54fe2a1e None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:40.608160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 165/325] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:40.613761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4cae-06fe-4e4b-ae76-33be8d6ac782 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:40.614056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4cae-06fe-4e4b-ae76-33be8d6ac782 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:40.614329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4cae-06fe-4e4b-ae76-33be8d6ac782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:40.632425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e93b4cae-06fe-4e4b-ae76-33be8d6ac782 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:40.633595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e93b4cae-06fe-4e4b-ae76-33be8d6ac782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:40.708433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 161/326] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:40.757999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13389f-8e95-4b54-b7ef-a10d54fe2a1e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:40.871294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13389f-8e95-4b54-b7ef-a10d54fe2a1e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:40.912994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:40.913632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:40.913911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:40.914238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:40.926943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:40.931826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:40.932732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:40.933520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 166/327] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:40.940563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b4cae-06fe-4e4b-ae76-33be8d6ac782 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:40.950349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:40.999542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:41.038939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:41.064414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b4cae-06fe-4e4b-ae76-33be8d6ac782 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:41.114861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:41.115868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:41.116343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:41.116915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:41.117797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:41.118289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:41.120091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:41.129460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ade155-8b61-4d8a-b66a-cc5984b467b9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:41.130283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 162/328] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:41.135431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:41.181176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:41.182169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:41.182643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:41.183126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:41.195686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:41.201191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:41.202072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:41.202882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:41.207740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 167/329] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:41.213885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:41.214204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:41.251241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a77e22-8e75-419a-833b-73b630eb62af None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:41.287261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:41.287887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:41.288166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:41.288473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] PATH_INFO: `/v3/users/1386adf9b7104315a11a90266652cf69` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:41.289638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] RBAC: Authorizing `identity:get_user(user_id=1386adf9b7104315a11a90266652cf69)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:41.291074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:41.293053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 163/330] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:41 2022] GET /identity/v3/users/1386adf9b7104315a11a90266652cf69 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:41.303363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:41.323327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:41.336598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118ac56-598b-4309-aedd-58ad1669a92b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:41.381034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:41.382006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:41.382486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:41.382975 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:41.383870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:41.384369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:41.386667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:41.399153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 168/331] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:41.404839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:41.430775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749390-e552-4618-84fe-990da2e9ea51 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:41.478993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:41.479664 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:41.479943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:41.480218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] PATH_INFO: `/v3/system/users/1386adf9b7104315a11a90266652cf69/roles/ebdde59a9acf4f6aab6348992db4ade2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:41.486322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1386adf9b7104315a11a90266652cf69, role_id=ebdde59a9acf4f6aab6348992db4ade2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:41.487791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:41.493113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:41.505841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 164/332] 10.222.0.42 () {58 vars in 1334 bytes} [Wed Aug 24 08:41:41 2022] PUT /identity/v3/system/users/1386adf9b7104315a11a90266652cf69/roles/ebdde59a9acf4f6aab6348992db4ade2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:41.538949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cb558-190e-4555-ada6-731becb50f49 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:41.588250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad63680-241c-43fa-8eb4-348b885819d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:41.588250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63680-241c-43fa-8eb4-348b885819d6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:41.588250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63680-241c-43fa-8eb4-348b885819d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:41.588250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63680-241c-43fa-8eb4-348b885819d6 None admin] PATH_INFO: `/v3/users/bfd2f5cd13854cacb5dd71d40cb80367` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:41.589150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad63680-241c-43fa-8eb4-348b885819d6 None admin] RBAC: Authorizing `identity:get_user(user_id=bfd2f5cd13854cacb5dd71d40cb80367)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:41.590715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad63680-241c-43fa-8eb4-348b885819d6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:41.592367 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 169/333] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:41 2022] GET /identity/v3/users/bfd2f5cd13854cacb5dd71d40cb80367 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:41.599311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:41.717552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da62f66-2663-44b9-a396-ec185096360b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:41.759874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762c53c-9171-4173-8f88-18144eea25e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:41.760423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c53c-9171-4173-8f88-18144eea25e8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:41.760711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c53c-9171-4173-8f88-18144eea25e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:41.760984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762c53c-9171-4173-8f88-18144eea25e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:41.761721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762c53c-9171-4173-8f88-18144eea25e8 None admin] RBAC: Adding query filter params (role.id=3a468bb5cd55417db77f4bb6f33b2817, user.id=bfd2f5cd13854cacb5dd71d40cb80367, scope.system=all) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:41.762028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762c53c-9171-4173-8f88-18144eea25e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:41.763714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762c53c-9171-4173-8f88-18144eea25e8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:41.779803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 165/334] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 08:41:41 2022] GET /identity/v3/role_assignments?user.id=bfd2f5cd13854cacb5dd71d40cb80367&scope.system=all&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:42.810430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28051021-0fd2-452f-8428-55f4bfda9927 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:42.811003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28051021-0fd2-452f-8428-55f4bfda9927 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:42.811003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28051021-0fd2-452f-8428-55f4bfda9927 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:42.812584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 170/335] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:42.819277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e8f9-d7fd-4117-bb16-a8ad6d622d12 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:42.819701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e8f9-d7fd-4117-bb16-a8ad6d622d12 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:42.819874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e8f9-d7fd-4117-bb16-a8ad6d622d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:42.840682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-50c2e8f9-d7fd-4117-bb16-a8ad6d622d12 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:42.841808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-50c2e8f9-d7fd-4117-bb16-a8ad6d622d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:42.910588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:42.927048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 166/336] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:43.332474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76265-3e70-47aa-a08d-fc840b13f24f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:43.332474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76265-3e70-47aa-a08d-fc840b13f24f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:43.332474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76265-3e70-47aa-a08d-fc840b13f24f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:43.334080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 171/337] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:43.341992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffaf4a-f6f7-4d2c-b24f-af995c67cb16 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:43.342283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffaf4a-f6f7-4d2c-b24f-af995c67cb16 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:43.342558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffaf4a-f6f7-4d2c-b24f-af995c67cb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:43.365368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c4ffaf4a-f6f7-4d2c-b24f-af995c67cb16 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:43.366568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c4ffaf4a-f6f7-4d2c-b24f-af995c67cb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:43.444358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 167/338] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:43.477706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76265-3e70-47aa-a08d-fc840b13f24f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:43.510392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:43.609561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76265-3e70-47aa-a08d-fc840b13f24f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:43.656041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:43.656722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:43.657004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:43.657287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:43.673391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:43.678701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:43.679568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:43.680343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 172/339] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:43.687886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffaf4a-f6f7-4d2c-b24f-af995c67cb16 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:43.805949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffaf4a-f6f7-4d2c-b24f-af995c67cb16 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:43.827012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:43.849783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:43.850752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:43.851256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:43.851723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:43.852626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:43.853129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:43.853231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:43.855158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:43.864904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 168/340] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:43.873450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:43.985628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:44.015804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151307-e178-419a-8fde-7c7bd60e5f69 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:44.019169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c588-2a32-4540-be56-c042c9a606d0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:44.071482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10add05f-50a8-4ac1-ab94-d9e8599395ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:44.072585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add05f-50a8-4ac1-ab94-d9e8599395ea None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.073089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add05f-50a8-4ac1-ab94-d9e8599395ea None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.073560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10add05f-50a8-4ac1-ab94-d9e8599395ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.077077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:44.077724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.078001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.078271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.093783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:44.098755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:44.099615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:44.100473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:44.104882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 173/341] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:44.111460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:44.138168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:44.163855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10add05f-50a8-4ac1-ab94-d9e8599395ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:44.165735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10add05f-50a8-4ac1-ab94-d9e8599395ea None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:44.277478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 169/342] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:44.279102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f010a-fc48-49fc-b506-6e23eb9dab46 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.279587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f010a-fc48-49fc-b506-6e23eb9dab46 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.280061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f010a-fc48-49fc-b506-6e23eb9dab46 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.282784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 170/343] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:44.283897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f010a-fc48-49fc-b506-6e23eb9dab46 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:44.284228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b397d5-6f65-40d0-9d79-8bd43cadf40e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:44.353153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266a004-1495-45a1-9a09-df3c8f8871ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:44.353792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a004-1495-45a1-9a09-df3c8f8871ae None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.354073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a004-1495-45a1-9a09-df3c8f8871ae None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.354343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266a004-1495-45a1-9a09-df3c8f8871ae None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.355024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266a004-1495-45a1-9a09-df3c8f8871ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:44.355326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266a004-1495-45a1-9a09-df3c8f8871ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:44.356750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266a004-1495-45a1-9a09-df3c8f8871ae None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:44.369306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 174/344] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:44.370710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5150-e3db-4449-83c7-ca0153b32682 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.370997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5150-e3db-4449-83c7-ca0153b32682 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.371468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d5150-e3db-4449-83c7-ca0153b32682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.384106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:44.387198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:44.397771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-393d5150-e3db-4449-83c7-ca0153b32682 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:44.398896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-393d5150-e3db-4449-83c7-ca0153b32682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:44.401084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f010a-fc48-49fc-b506-6e23eb9dab46 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:44.441013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:44.442076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.442576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.443313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.446629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:44.448498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:44.450469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 171/345] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:44 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:44.451572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:44.484046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 175/346] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:44.486966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d5150-e3db-4449-83c7-ca0153b32682 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:44.597168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d5150-e3db-4449-83c7-ca0153b32682 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:44.625195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e1cfe-2452-499f-a109-8ed3c487e412 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:44.633451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:44.634088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.634421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.634703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.639292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:44.643487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:44.646529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:44.649557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 176/347] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:44 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:44.655587 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:44.737189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf7af5-c397-43e8-9bd5-6d391e8c9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:44.737824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7af5-c397-43e8-9bd5-6d391e8c9868 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.738113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7af5-c397-43e8-9bd5-6d391e8c9868 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.738393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf7af5-c397-43e8-9bd5-6d391e8c9868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.764802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2ab2e-965d-48d9-b0c3-0f422d7a8714 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:44.767048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:44.806760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a853-0daa-45ea-a384-fd76ab569bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:44.807746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a853-0daa-45ea-a384-fd76ab569bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.808224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a853-0daa-45ea-a384-fd76ab569bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.808745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a853-0daa-45ea-a384-fd76ab569bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.809790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a853-0daa-45ea-a384-fd76ab569bf1 None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:44.810609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a853-0daa-45ea-a384-fd76ab569bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:44.813715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a853-0daa-45ea-a384-fd76ab569bf1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:44.826067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 177/348] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:44 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:44.828644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3db33-e0ac-4eb7-8da6-65eaa850e09e None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.829464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3db33-e0ac-4eb7-8da6-65eaa850e09e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.830068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3db33-e0ac-4eb7-8da6-65eaa850e09e None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.832244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 178/349] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:44.833605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c7ed-f381-45f4-ad6f-d798eb3b0781 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.833989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c7ed-f381-45f4-ad6f-d798eb3b0781 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.834360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61c7ed-f381-45f4-ad6f-d798eb3b0781 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.839293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf7af5-c397-43e8-9bd5-6d391e8c9868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:44.840769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 179/350] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:44.841542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf7af5-c397-43e8-9bd5-6d391e8c9868 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:44.842179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8d817-3697-4855-a927-f7af8484feb8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.842561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8d817-3697-4855-a927-f7af8484feb8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.842953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8d817-3697-4855-a927-f7af8484feb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:44.863281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9cd8d817-3697-4855-a927-f7af8484feb8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:44.864732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9cd8d817-3697-4855-a927-f7af8484feb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:44.996422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 172/351] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:44.997614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b544c51-44ef-4b50-bbb6-ba8d5f1244b6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:44.997722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:44.997909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b544c51-44ef-4b50-bbb6-ba8d5f1244b6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:44.998180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b544c51-44ef-4b50-bbb6-ba8d5f1244b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.023828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9b544c51-44ef-4b50-bbb6-ba8d5f1244b6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:45.025441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9b544c51-44ef-4b50-bbb6-ba8d5f1244b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:45.030161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 180/352] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:45.030161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8d817-3697-4855-a927-f7af8484feb8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.131525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:45.161087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8d817-3697-4855-a927-f7af8484feb8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.182034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 173/353] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:45.182923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b544c51-44ef-4b50-bbb6-ba8d5f1244b6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.213784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.214927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.215211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.215491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.234484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:45.240222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:45.241168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:45.241971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 181/354] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:45.249678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.325275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:45.387459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b544c51-44ef-4b50-bbb6-ba8d5f1244b6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.395324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5265-2fec-49dd-b67e-7b2722f07440 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.426808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.427465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.427751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.428031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.429279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:45.430838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:45.433222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 174/355] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:45.434144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.437267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.438006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.438297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.438584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.439269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:45.439575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:45.441558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:45.454483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 182/356] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:45.455451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.492662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:45.548607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a48928-1d53-4dfc-9e30-e536f2b51127 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.566061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152e65d-6969-465d-a681-d53434207b73 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.580614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:45.595177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.595832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.596115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.596442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.616790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:45.625431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:45.626317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:45.627138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:45.628133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.628736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 175/357] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:45.628894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.629053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.632410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.632618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.632803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:45.632803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:45.634014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 183/358] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:45.639172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.778888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0a8b-4a84-4ad6-b528-5c1796e95579 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.780863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdfa37-5997-4418-a4ac-343bcf688fb7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.788545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:45.817404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.818505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.819042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.819575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.820593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:45.821150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:45.821560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.822312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.822661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.823005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.823536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:45.832295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 184/359] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:45.833446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:45.882695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:45.900006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:45.901746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:45.950217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06e541-339a-4339-9200-c335d846c88e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:45.996409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:45.997030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:45.997311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:45.997589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:45.998323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:45.998637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:46.000100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:46.008284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 185/360] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:46.009666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.027199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 176/361] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:46.028577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.044758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:46.139055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678b03d-80ad-4c9a-b6dd-183368988acd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:46.148934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:46.168216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d1b6e-0668-423e-82aa-eb66abd24ffb None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:46.186200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87dfe3-ba79-438e-90db-7e183b52ff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:46.186859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87dfe3-ba79-438e-90db-7e183b52ff45 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.187137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87dfe3-ba79-438e-90db-7e183b52ff45 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.187416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87dfe3-ba79-438e-90db-7e183b52ff45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.199998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87dfe3-ba79-438e-90db-7e183b52ff45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ef87dfe3-ba79-438e-90db-7e183b52ff45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:46.208356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:46.209355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 08:41:46.210157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:46.210786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 186/362] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:46.211990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7b0b-9a8e-4373-b6d2-87f620446a18 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.212272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7b0b-9a8e-4373-b6d2-87f620446a18 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.212645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7b0b-9a8e-4373-b6d2-87f620446a18 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.215827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 187/363] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:46.215827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7b0b-9a8e-4373-b6d2-87f620446a18 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.224650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265d474-13f0-40e7-a5c6-ed477c24d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:46.225287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d474-13f0-40e7-a5c6-ed477c24d744 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.225574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d474-13f0-40e7-a5c6-ed477c24d744 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.225852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265d474-13f0-40e7-a5c6-ed477c24d744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.313519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265d474-13f0-40e7-a5c6-ed477c24d744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:46.316240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265d474-13f0-40e7-a5c6-ed477c24d744 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:46.326214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:46.352482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7b0b-9a8e-4373-b6d2-87f620446a18 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:46.399250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:46.399591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.400252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.400654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.402552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:46.404427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:46.407665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 188/364] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:46.408586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.443908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 177/365] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:46.445521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d771a-32d2-49cf-856f-65a725d130cc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.445940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d771a-32d2-49cf-856f-65a725d130cc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.446357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d771a-32d2-49cf-856f-65a725d130cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.453379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:46.468145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2e6d771a-32d2-49cf-856f-65a725d130cc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:46.469724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2e6d771a-32d2-49cf-856f-65a725d130cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:46.545702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22428b02-ac42-4559-828b-92fdaffa3638 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:46.555619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 178/366] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:46.556954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d771a-32d2-49cf-856f-65a725d130cc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.605695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:46.606569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.606991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.607469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.608341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:46.608887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:46.610478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:46.612203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:46.625841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 189/367] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:46.626988 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.736894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d771a-32d2-49cf-856f-65a725d130cc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:46.792858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:46.793511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.793804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.794088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.795307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:46.796788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:46.798366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 179/368] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:46.799135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.807705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:46.817742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeff263-bf39-4118-9c8d-bfcb4bc63aac None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:46.870149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:46.870853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:46.871143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:46.871418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:46.875334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:46.876993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:46.878877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 190/369] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:46.879667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:46.949793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795762-2ce8-41a7-afbc-ef0a11511401 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:46.952920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:47.000621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.001189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.001473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.001751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] PATH_INFO: `/v3/users/1386adf9b7104315a11a90266652cf69` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.003637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] RBAC: Authorizing `identity:get_user(user_id=1386adf9b7104315a11a90266652cf69)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:47.005398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:47.008143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 180/370] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/users/1386adf9b7104315a11a90266652cf69 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:47.009128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:47.012933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42791546-d781-414a-91a4-c13cb8030423 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:47.054394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727314ef-4380-4822-9133-a428aad10eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.055378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727314ef-4380-4822-9133-a428aad10eba None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.055726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727314ef-4380-4822-9133-a428aad10eba None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.056087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727314ef-4380-4822-9133-a428aad10eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.056977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727314ef-4380-4822-9133-a428aad10eba None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:47.057357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727314ef-4380-4822-9133-a428aad10eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:47.058885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727314ef-4380-4822-9133-a428aad10eba None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:47.066806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 191/371] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:46 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:47.072542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727314ef-4380-4822-9133-a428aad10eba None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:47.132426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:47.179782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e81db-c5ea-412c-97ca-725ad0c262d8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:47.218038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.218693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.218954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.219225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.220597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:47.222125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:47.224890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 181/372] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:47 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:47.225732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:47.228192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727314ef-4380-4822-9133-a428aad10eba None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:47.272965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7dba7-c732-4219-8d64-38ba05c3528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.273318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7dba7-c732-4219-8d64-38ba05c3528f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.273653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7dba7-c732-4219-8d64-38ba05c3528f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.273923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7dba7-c732-4219-8d64-38ba05c3528f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.278132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:47.288731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7dba7-c732-4219-8d64-38ba05c3528f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-63b7dba7-c732-4219-8d64-38ba05c3528f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:47.294221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:47.295093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:47.295966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 192/373] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:47.298627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edf87-3c8c-41fe-a0ba-bbba7687a303 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.298627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edf87-3c8c-41fe-a0ba-bbba7687a303 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.298627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edf87-3c8c-41fe-a0ba-bbba7687a303 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.299899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 193/374] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:47.300645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edf87-3c8c-41fe-a0ba-bbba7687a303 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:47.347273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63d2e3-542e-4e39-8529-ae0cfbef6859 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:47.390577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078cdae-99c3-4778-b9e1-80854f777e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.391196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078cdae-99c3-4778-b9e1-80854f777e21 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.391481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078cdae-99c3-4778-b9e1-80854f777e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.391754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078cdae-99c3-4778-b9e1-80854f777e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.392523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078cdae-99c3-4778-b9e1-80854f777e21 None admin] RBAC: Adding query filter params (role.id=ebdde59a9acf4f6aab6348992db4ade2, user.id=1386adf9b7104315a11a90266652cf69, scope.system=all) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:47.392834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078cdae-99c3-4778-b9e1-80854f777e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:47.394979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078cdae-99c3-4778-b9e1-80854f777e21 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:47.411388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 182/375] 10.222.0.42 () {56 vars in 1308 bytes} [Wed Aug 24 08:41:47 2022] GET /identity/v3/role_assignments?user.id=1386adf9b7104315a11a90266652cf69&scope.system=all&role.id=ebdde59a9acf4f6aab6348992db4ade2 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:47.412280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ef3f-c54e-4ba8-ab05-99a44db1d06b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.412602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ef3f-c54e-4ba8-ab05-99a44db1d06b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.412879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1ef3f-c54e-4ba8-ab05-99a44db1d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.421563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:47.435557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edf87-3c8c-41fe-a0ba-bbba7687a303 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:47.436955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c6b1ef3f-c54e-4ba8-ab05-99a44db1d06b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:47.438380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c6b1ef3f-c54e-4ba8-ab05-99a44db1d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:47.486511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.488012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.488496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.488948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.489860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:47.490360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:47.492723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:47.502146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 194/376] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:47 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:47.503937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:47.527633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 183/377] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:47.623105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831ca65-99b7-42de-abf6-7950e1753890 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:47.660278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.660934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.661213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.661483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.662154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:47.662453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:47.663832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:47.673397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 195/378] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:47.679987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ef3f-c54e-4ba8-ab05-99a44db1d06b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:47.711270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:47.790804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1ef3f-c54e-4ba8-ab05-99a44db1d06b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:47.827141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:47.827761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:47.828042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:47.828317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:47.847639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:47.880334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:47.925138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:47.926632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:47.955312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:48.039204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 184/379] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:48.050329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:48.062700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07103e1-570b-4e65-b8ba-a608bf448726 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:48.137137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:48.137796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.138075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.138348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.172445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:48.172753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6851b-1e2a-414f-a6bf-5d3a6ce98ced None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:48.177870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:48.178759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:48.179537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 196/380] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:48.195857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:48.216790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:48.222448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:48.223250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.223623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.224006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] PATH_INFO: `/v3/projects/99f84482a9b64bcfb8dae5485dc7545f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.225269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] RBAC: Authorizing `identity:get_project(project_id=99f84482a9b64bcfb8dae5485dc7545f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:48.227256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:48.229314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 185/381] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:48 2022] GET /identity/v3/projects/99f84482a9b64bcfb8dae5485dc7545f => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:48.240669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:48.312535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:48.340783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7fc6b-8dee-46c4-84d8-733af2f9c9d5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:48.384614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:48.385254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.385527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.385795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.386577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:48.386889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:48.388817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:48.396187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb77bc-8cda-4c93-9edb-11d1f7f63b1c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:48.398697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 197/382] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:48.404684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:48.433122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:48.434114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.434597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.435092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] PATH_INFO: `/v3/groups/0bf7e2cd54ef4d668ef466725a34910b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.443348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] RBAC: Authorizing `identity:get_group(group_id=0bf7e2cd54ef4d668ef466725a34910b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:48.445139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:48.447303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 186/383] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:48 2022] GET /identity/v3/groups/0bf7e2cd54ef4d668ef466725a34910b => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:48.453297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:48.530303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:48.598480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f74047-8a40-4bae-a51b-45bc945c8896 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:48.623869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a9bb7-fd1f-4468-8e58-b314311582f6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:48.639116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:48.640066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.641654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.642136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.643770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] RBAC: Adding query filter params (group.id=0bf7e2cd54ef4d668ef466725a34910b, role.id=759ce9628735416988d65affdc29c636, scope.project.id=99f84482a9b64bcfb8dae5485dc7545f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:48.644338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:48.646135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:48.652425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 187/384] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:48 2022] GET /identity/v3/role_assignments?group.id=0bf7e2cd54ef4d668ef466725a34910b&scope.project.id=99f84482a9b64bcfb8dae5485dc7545f&role.id=759ce9628735416988d65affdc29c636 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:48.684299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e224f1-ff6b-45cb-9fec-4c84c81920c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:48.685004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e224f1-ff6b-45cb-9fec-4c84c81920c4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.685288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e224f1-ff6b-45cb-9fec-4c84c81920c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.685652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e224f1-ff6b-45cb-9fec-4c84c81920c4 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.694647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e224f1-ff6b-45cb-9fec-4c84c81920c4 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:48.696183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e224f1-ff6b-45cb-9fec-4c84c81920c4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:48.697959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 198/385] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:48 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:48.703702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:48.846102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f01b0-1fec-4a30-9e8a-800aa7eb640a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:48.887913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:48.901250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:48.902219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.902700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.903196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.906649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:48.908321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:48.910563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 188/386] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:48 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:48.912136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb499-f160-4b09-8581-3fed8d79094c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.912440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb499-f160-4b09-8581-3fed8d79094c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.912720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cb499-f160-4b09-8581-3fed8d79094c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.915712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:48.916071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 199/387] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:48.920873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68352ff-1cb8-47af-900a-c840c53f50f5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:48.921201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68352ff-1cb8-47af-900a-c840c53f50f5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:48.921424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68352ff-1cb8-47af-900a-c840c53f50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:48.949614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:48.961592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d68352ff-1cb8-47af-900a-c840c53f50f5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:48.962585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d68352ff-1cb8-47af-900a-c840c53f50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:49.077362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5235a-e243-46a2-b867-55f322476fae None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:49.089702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 200/388] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:49.120596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418930f6-6e95-42b4-a39e-2236d09343d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:49.121585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418930f6-6e95-42b4-a39e-2236d09343d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:49.122066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418930f6-6e95-42b4-a39e-2236d09343d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:49.122560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418930f6-6e95-42b4-a39e-2236d09343d1 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/groups/0f888e1d45cc42b18b9af6accdce38da/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:49.124784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418930f6-6e95-42b4-a39e-2236d09343d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e631e8904fe4c058b2f79e89c9fbb3f, group_id=0f888e1d45cc42b18b9af6accdce38da, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:49.126476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418930f6-6e95-42b4-a39e-2236d09343d1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:49.143038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 189/389] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 08:41:48 2022] PUT /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/groups/0f888e1d45cc42b18b9af6accdce38da/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:41:49.547499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68352ff-1cb8-47af-900a-c840c53f50f5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:49.602610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854eff-353d-41ce-9833-ef848719aa08 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:49.602915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854eff-353d-41ce-9833-ef848719aa08 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:49.603208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2854eff-353d-41ce-9833-ef848719aa08 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:49.604878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 190/390] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:49.609846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921133b-1293-4803-8cda-94e5e430e3c0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:49.610402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921133b-1293-4803-8cda-94e5e430e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:49.610547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921133b-1293-4803-8cda-94e5e430e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:49.649447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0921133b-1293-4803-8cda-94e5e430e3c0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:49.650988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0921133b-1293-4803-8cda-94e5e430e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:49.684769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68352ff-1cb8-47af-900a-c840c53f50f5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:49.726580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:49.727460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:49.727881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:49.728295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:49.731441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:49.743403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:49.748717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:49.749807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:49.750810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 201/391] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:49.757219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:49.760769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:49.781381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 191/392] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:49.921969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e99061-cb07-4852-a1aa-3faf87864d99 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:49.964996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:49.965610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:49.965887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:49.966159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:49.966831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:49.967133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:49.968539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:49.978681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 202/393] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:49.984061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921133b-1293-4803-8cda-94e5e430e3c0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:50.118833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921133b-1293-4803-8cda-94e5e430e3c0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:50.156259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:50.157297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.157781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.158278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.159671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:50.161341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:50.163419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 192/394] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:49 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:50.168890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:50.189739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:50.252933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:50.271900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:50.303593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683010ed-a3ba-4a07-b4d2-cf2fbdd80413 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:50.343971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:50.344804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.345234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.345615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.357200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:50.361619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713617b8-d955-4d3a-a30b-2843bed55907 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:50.362880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:50.363965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:50.364895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:41:50.365812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 193/395] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:50.371842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:50.419493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e5b69-e3c6-4d31-aea9-98de734b9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:50.420142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5b69-e3c6-4d31-aea9-98de734b9ede None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.420462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5b69-e3c6-4d31-aea9-98de734b9ede None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.420743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e5b69-e3c6-4d31-aea9-98de734b9ede None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.421869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5b69-e3c6-4d31-aea9-98de734b9ede None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:50.423324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e5b69-e3c6-4d31-aea9-98de734b9ede None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:50.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 203/396] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:50 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:50.427103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1a366-d5b0-430c-a6bd-88b7be224bf1 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.427386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1a366-d5b0-430c-a6bd-88b7be224bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.427657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1a366-d5b0-430c-a6bd-88b7be224bf1 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.428889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 204/397] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:50.434523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1a366-d5b0-430c-a6bd-88b7be224bf1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:50.482239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed09c00-4166-4b40-a1fa-38b958af5ab1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:50.496783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:50.528102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0f0b7-4bc8-41b3-a692-1a4d981134e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:50.528763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f0b7-4bc8-41b3-a692-1a4d981134e0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.529059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f0b7-4bc8-41b3-a692-1a4d981134e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.529344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0f0b7-4bc8-41b3-a692-1a4d981134e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.530303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f0b7-4bc8-41b3-a692-1a4d981134e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:50.531112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f0b7-4bc8-41b3-a692-1a4d981134e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:50.532887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0f0b7-4bc8-41b3-a692-1a4d981134e0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:50.545431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 194/398] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:50.547246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cc666-af52-4456-b083-e285ccc01d98 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.547543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cc666-af52-4456-b083-e285ccc01d98 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.548249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cc666-af52-4456-b083-e285ccc01d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.555076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1a366-d5b0-430c-a6bd-88b7be224bf1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:50.575895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-575cc666-af52-4456-b083-e285ccc01d98 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:50.577368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-575cc666-af52-4456-b083-e285ccc01d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:50.596797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:50.606772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:50.607891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.608277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.608842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/groups/0f888e1d45cc42b18b9af6accdce38da/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.613283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e631e8904fe4c058b2f79e89c9fbb3f, group_id=0f888e1d45cc42b18b9af6accdce38da, role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:50.615394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:50.632906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 205/399] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 08:41:50 2022] PUT /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f/groups/0f888e1d45cc42b18b9af6accdce38da/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:50.633978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:50.675947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 195/400] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:50.776070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53431e9-7ec8-4ae2-9205-4d30c481d5c2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:50.829292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edb31f-844b-4124-b552-83818dcc66e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:50.829964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edb31f-844b-4124-b552-83818dcc66e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.830253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edb31f-844b-4124-b552-83818dcc66e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.830627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edb31f-844b-4124-b552-83818dcc66e7 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.831965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edb31f-844b-4124-b552-83818dcc66e7 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:50.833486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edb31f-844b-4124-b552-83818dcc66e7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:50.835083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 206/401] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:50 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:50.841875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cc666-af52-4456-b083-e285ccc01d98 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:50.891118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bbc5c-b24b-4b32-aac7-3c6ac307014f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.891751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bbc5c-b24b-4b32-aac7-3c6ac307014f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.892298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bbc5c-b24b-4b32-aac7-3c6ac307014f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.894426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 207/402] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:50.899579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c998e-e2c2-47e7-8ff5-123e8a697bb5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:50.900258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c998e-e2c2-47e7-8ff5-123e8a697bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:50.900759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c998e-e2c2-47e7-8ff5-123e8a697bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:50.929870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-474c998e-e2c2-47e7-8ff5-123e8a697bb5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:50.931073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-474c998e-e2c2-47e7-8ff5-123e8a697bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:50.962987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cc666-af52-4456-b083-e285ccc01d98 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:50.964562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:51.000995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:51.001765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:51.002120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:51.002643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:51.003941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:51.005460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:51.007505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 196/403] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:50 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:51.014310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:51.041723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:51.068364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 208/404] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:51.069359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c998e-e2c2-47e7-8ff5-123e8a697bb5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:51.161863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4011de-fdaf-402e-992a-ebcb82a5adf1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:51.215776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c998e-e2c2-47e7-8ff5-123e8a697bb5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:51.228510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:51.229186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:51.229473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:51.229743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/groups/0f888e1d45cc42b18b9af6accdce38da/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:51.234774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] RBAC: Authorizing `identity:create_grant(project_id=77a19a4d5b8742af8c2028ccba21a2db, group_id=0f888e1d45cc42b18b9af6accdce38da, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:51.236219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:51.266148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 197/405] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 08:41:51 2022] PUT /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/groups/0f888e1d45cc42b18b9af6accdce38da/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:51.274164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:51.274921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:51.275204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:51.275479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:51.289105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:51.294027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:51.294980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:51.295780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 209/406] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:51.301181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:51.335687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:51.435815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08c586-de04-4f96-af8e-e11ad2ffed96 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:51.482455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:51.483122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:51.483408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:51.483696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:51.484850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:51.488227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:51.488227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:51.488227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:51.501599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 198/407] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:51.508961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:51.545878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:51.626364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac6bd0-101e-4c5b-b2e6-6380ef705761 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:51.663654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:51.678415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f123bdb-a1f5-4005-805e-b54c79a42981 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:51.695082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:51.695730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:51.696013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:51.696286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:51.717204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:51.722088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:51.723037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:51.723813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:51.724904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 210/408] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:51.734397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:51.745160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:51.745817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:51.746100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:51.746378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:51.747955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:51.749426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:51.751028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 199/409] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:51 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:51.757320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:51.935763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62299b8f-1992-4338-b20d-e92d7120b127 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:51.942463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:51.956818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3033f-05fb-4948-95c2-d6c3a9f123e3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:52.006289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:52.006924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.007209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.007486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.008164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:52.008495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:52.009893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:52.026349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:52.027025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.027314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.027591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.031634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 211/410] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:52.032485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:52.034525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:52.036596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 200/411] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:51 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:52.042031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:52.043218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:52.079351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:52.176130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1678410-363a-4d35-813f-9676b84574a2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:52.181258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d2bdd-1440-441e-8dcd-59068a76b66a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:52.216082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:52.217418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.217925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.218385 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/groups/0f888e1d45cc42b18b9af6accdce38da/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.220929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] RBAC: Authorizing `identity:create_grant(project_id=77a19a4d5b8742af8c2028ccba21a2db, group_id=0f888e1d45cc42b18b9af6accdce38da, role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:52.223720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:52.228322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded4a7-6ecd-446f-a078-60bb158ad3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:52.229291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded4a7-6ecd-446f-a078-60bb158ad3dc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.229666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded4a7-6ecd-446f-a078-60bb158ad3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.230014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded4a7-6ecd-446f-a078-60bb158ad3dc None admin] PATH_INFO: `/v3/groups/0bf7e2cd54ef4d668ef466725a34910b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.231259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eded4a7-6ecd-446f-a078-60bb158ad3dc None admin] RBAC: Authorizing `identity:get_group(group_id=0bf7e2cd54ef4d668ef466725a34910b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:52.232907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eded4a7-6ecd-446f-a078-60bb158ad3dc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:52.234736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 201/412] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:52 2022] GET /identity/v3/groups/0bf7e2cd54ef4d668ef466725a34910b => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:52.238764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 212/413] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 08:41:52 2022] PUT /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db/groups/0f888e1d45cc42b18b9af6accdce38da/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:52.240182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bed6e-e839-4e00-8cbf-4fa670eadf31 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.244427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bed6e-e839-4e00-8cbf-4fa670eadf31 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.244427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bed6e-e839-4e00-8cbf-4fa670eadf31 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.244427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 202/414] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:52.249624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:52.250465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8aa4-0d1a-457e-a7e3-3fd37849874d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.250934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8aa4-0d1a-457e-a7e3-3fd37849874d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.251388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e8aa4-0d1a-457e-a7e3-3fd37849874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.288453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b40e8aa4-0d1a-457e-a7e3-3fd37849874d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:52.292599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b40e8aa4-0d1a-457e-a7e3-3fd37849874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:52.317507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:52.403127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 203/415] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:52.440961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa686a-2272-49d4-b610-958b8dfa0751 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:52.475785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:52.476395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.476689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.476961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] PATH_INFO: `/v3/projects/99f84482a9b64bcfb8dae5485dc7545f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.478090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=99f84482a9b64bcfb8dae5485dc7545f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:52.479537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:52.481644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 213/416] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:52 2022] GET /identity/v3/projects/99f84482a9b64bcfb8dae5485dc7545f => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:52.488014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e8aa4-0d1a-457e-a7e3-3fd37849874d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:52.516350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:52.593530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e8aa4-0d1a-457e-a7e3-3fd37849874d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:52.629046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a711da3-7f1c-45a3-a602-203f13bba7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:52.629710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711da3-7f1c-45a3-a602-203f13bba7db None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:52.629983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711da3-7f1c-45a3-a602-203f13bba7db None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:52.630250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a711da3-7f1c-45a3-a602-203f13bba7db None admin] PATH_INFO: `/v3/projects/99f84482a9b64bcfb8dae5485dc7545f/groups/0bf7e2cd54ef4d668ef466725a34910b/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:52.632144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a711da3-7f1c-45a3-a602-203f13bba7db None admin] RBAC: Authorizing `identity:create_grant(project_id=99f84482a9b64bcfb8dae5485dc7545f, group_id=0bf7e2cd54ef4d668ef466725a34910b, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:52.633640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a711da3-7f1c-45a3-a602-203f13bba7db None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:52.648424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 204/417] 10.222.0.42 () {58 vars in 1442 bytes} [Wed Aug 24 08:41:52 2022] PUT /identity/v3/projects/99f84482a9b64bcfb8dae5485dc7545f/groups/0bf7e2cd54ef4d668ef466725a34910b/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:41:52.839086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:52.966289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:52.974237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcabbfb-0910-4586-83a5-6a6bf6c8d6d7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:53.010695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61386126-e3e5-4000-a999-fb423399298b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.011030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61386126-e3e5-4000-a999-fb423399298b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.011249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61386126-e3e5-4000-a999-fb423399298b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.013158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 205/418] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:53.019720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765303-c7a6-494b-8b4a-963cb1254bba None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.020004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765303-c7a6-494b-8b4a-963cb1254bba None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.020278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765303-c7a6-494b-8b4a-963cb1254bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.030951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:53.031601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.031884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.032161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.040758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a1765303-c7a6-494b-8b4a-963cb1254bba None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:53.042191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a1765303-c7a6-494b-8b4a-963cb1254bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:53.057362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:53.062922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:53.063862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:53.064744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 214/419] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:53.077761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:53.124979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 206/420] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:53.242766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d08e84-c3ae-437a-a152-816978a42dae None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:53.277380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:53.277992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.278268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.278538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.279201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:53.279500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:53.280964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:53.294123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 215/421] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:53.295536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765303-c7a6-494b-8b4a-963cb1254bba None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:53.320823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:53.398524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765303-c7a6-494b-8b4a-963cb1254bba None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:53.415602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:53.439052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:53.439667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.440509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.440786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.461815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:53.513610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:53.515442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:53.540766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:53.628129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 207/422] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:53.630798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:53.722489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d336e9-2a6b-42a4-8e9e-695a3583f07c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:53.786349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae513d-b6cb-426e-8295-aa1bfbfeae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:53.787382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae513d-b6cb-426e-8295-aa1bfbfeae49 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.787863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae513d-b6cb-426e-8295-aa1bfbfeae49 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.788353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae513d-b6cb-426e-8295-aa1bfbfeae49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.799575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae513d-b6cb-426e-8295-aa1bfbfeae49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:53.804093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74ed81-67f5-46f6-9477-fd46c4fb4a37 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f7ae513d-b6cb-426e-8295-aa1bfbfeae49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:53.805566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:53.806440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:53.807233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:53.814264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 216/423] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:41:53.816435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6038037-712e-4534-8472-9d58bc972d0f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.816925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6038037-712e-4534-8472-9d58bc972d0f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.817415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6038037-712e-4534-8472-9d58bc972d0f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.819330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 217/424] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:53.820243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6038037-712e-4534-8472-9d58bc972d0f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:53.821442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:53.839757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb68e18-4a61-4078-909f-2ce8789cbc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:53.840484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb68e18-4a61-4078-909f-2ce8789cbc53 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.840758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb68e18-4a61-4078-909f-2ce8789cbc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.841025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb68e18-4a61-4078-909f-2ce8789cbc53 None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.842219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb68e18-4a61-4078-909f-2ce8789cbc53 None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:53.843761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb68e18-4a61-4078-909f-2ce8789cbc53 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:53.845483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 208/425] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:53 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:53.851141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31984a-00d2-4451-9670-ff12f78b1021 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:53.851425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31984a-00d2-4451-9670-ff12f78b1021 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:53.851704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31984a-00d2-4451-9670-ff12f78b1021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:53.870615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ce31984a-00d2-4451-9670-ff12f78b1021 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:53.871851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ce31984a-00d2-4451-9670-ff12f78b1021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:53.920844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:53.940544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 209/426] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:53.941519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31984a-00d2-4451-9670-ff12f78b1021 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:53.944751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6038037-712e-4534-8472-9d58bc972d0f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.013408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.014201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.014475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.014738 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.015400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:54.015699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:54.017106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:54.032492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 218/427] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:54.037246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:54.134535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31984a-00d2-4451-9670-ff12f78b1021 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.152922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1bf9a-e88b-419e-8ada-9f3ec5606641 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.164033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:54.194552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.195463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.195899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.196358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.202826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.203696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.204125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.204596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.209087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:54.210712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:54.213862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 210/428] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:53 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:54.216745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:54.219423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:54.277742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:54.279318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:54.389305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f8741-02ab-4cf0-9f5a-2a7583de0000 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.397253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 219/429] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 08:41:54.398182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:54.424794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.425415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.425705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.425987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.426724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:54.427035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:54.428519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:54.434688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 211/430] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:54 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:54.435519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:54.454982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:54.508830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:54.559722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6993ef9-8035-44ad-bc88-1a33df82554b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.630161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d306ca-554a-4536-a08e-47c96ddf88e2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.636007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae411f7f-b156-497a-bacf-7da3921c8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.636673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411f7f-b156-497a-bacf-7da3921c8d2f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.636955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411f7f-b156-497a-bacf-7da3921c8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.637220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae411f7f-b156-497a-bacf-7da3921c8d2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.651349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae411f7f-b156-497a-bacf-7da3921c8d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ae411f7f-b156-497a-bacf-7da3921c8d2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:54.659325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:54.660213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:54.661461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 220/431] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:54.662389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8add2-c351-4b53-868c-a28aa1bf86e3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.662389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8add2-c351-4b53-868c-a28aa1bf86e3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.662389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8add2-c351-4b53-868c-a28aa1bf86e3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.665482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 221/432] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:54.668098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8add2-c351-4b53-868c-a28aa1bf86e3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:54.681038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff1f15-7b8c-4eb5-9b3e-57c89337fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.682112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff1f15-7b8c-4eb5-9b3e-57c89337fd1c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.682575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff1f15-7b8c-4eb5-9b3e-57c89337fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.683032 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff1f15-7b8c-4eb5-9b3e-57c89337fd1c None admin] PATH_INFO: `/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.684354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff1f15-7b8c-4eb5-9b3e-57c89337fd1c None admin] RBAC: Authorizing `identity:get_project(project_id=4e631e8904fe4c058b2f79e89c9fbb3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:54.686143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff1f15-7b8c-4eb5-9b3e-57c89337fd1c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:54.688457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 212/433] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:54 2022] GET /identity/v3/projects/4e631e8904fe4c058b2f79e89c9fbb3f => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:54.690662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dd69-8975-4e96-a16f-753cdcffc576 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.691144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dd69-8975-4e96-a16f-753cdcffc576 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.691588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0dd69-8975-4e96-a16f-753cdcffc576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.714964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-39a0dd69-8975-4e96-a16f-753cdcffc576 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:54.716463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-39a0dd69-8975-4e96-a16f-753cdcffc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:54.801908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:54.809848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8add2-c351-4b53-868c-a28aa1bf86e3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.823373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 213/434] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:54.827386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0dd69-8975-4e96-a16f-753cdcffc576 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:54.860255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57fcb8-c7b9-449c-bbb1-27172f40d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.861343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57fcb8-c7b9-449c-bbb1-27172f40d007 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.862284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57fcb8-c7b9-449c-bbb1-27172f40d007 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.862558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57fcb8-c7b9-449c-bbb1-27172f40d007 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.864043 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57fcb8-c7b9-449c-bbb1-27172f40d007 None admin] RBAC: Adding query filter params (name=member) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:54.864348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57fcb8-c7b9-449c-bbb1-27172f40d007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:54.865779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57fcb8-c7b9-449c-bbb1-27172f40d007 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:54.875338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:54.875777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 222/435] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:41:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:54.882095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303756f-952e-49b0-b1f4-752451599f7b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.882382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303756f-952e-49b0-b1f4-752451599f7b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.882653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303756f-952e-49b0-b1f4-752451599f7b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.884311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 223/436] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:54.888501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303756f-952e-49b0-b1f4-752451599f7b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:54.948221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0dd69-8975-4e96-a16f-753cdcffc576 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:54.994875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50611c77-56c2-4abd-a008-7d194bba171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:54.995526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611c77-56c2-4abd-a008-7d194bba171f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:54.995812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611c77-56c2-4abd-a008-7d194bba171f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:54.996087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50611c77-56c2-4abd-a008-7d194bba171f None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:54.997736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50611c77-56c2-4abd-a008-7d194bba171f None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:54.999702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50611c77-56c2-4abd-a008-7d194bba171f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.002114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 214/437] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:54 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:55.003152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c954c7-a823-4e49-b19e-2da1ef2130e8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.003444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c954c7-a823-4e49-b19e-2da1ef2130e8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.003722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c954c7-a823-4e49-b19e-2da1ef2130e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.013597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303756f-952e-49b0-b1f4-752451599f7b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.024842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-54c954c7-a823-4e49-b19e-2da1ef2130e8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:55.026167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-54c954c7-a823-4e49-b19e-2da1ef2130e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:55.050410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.051013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.051290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.051651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.078965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.112411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 215/438] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:55.112411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c954c7-a823-4e49-b19e-2da1ef2130e8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.130916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:55.132446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.149586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.209653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c954c7-a823-4e49-b19e-2da1ef2130e8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.242506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 224/439] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:55.242506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.249760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.250439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.250787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.251127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.251925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:55.252844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:55.254356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.260575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 216/440] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=4e631e8904fe4c058b2f79e89c9fbb3f&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:55.261333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.318569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.374226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7890fb5-773d-47f9-9694-d1167c88194a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.396980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e97fd-802e-4f99-ae8c-418e5f45dd01 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.406741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.413361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.414015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.414296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.414572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.427796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:55.432822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:55.434037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 225/441] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:55.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.443738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.444403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.444698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.444971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.447026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:55.447536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.449221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 217/442] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:55.449989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.564140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533bce-d54e-429c-bed7-75cef6cda711 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.569475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96bc81-ba43-4dd8-a3dc-c956f10305b6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.591157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.610073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.610716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.610999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.611278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.614941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.615088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.615310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.615585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.616444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:55.616650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:55.618014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.626665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:41:55.627350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 218/443] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:55.628176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:41:55.631472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:55.632570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:55.633373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 226/444] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:55.634020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.670613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.733805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc755c-e814-4235-9383-ced734b51547 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.743398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b96f7-def1-4e6e-b941-bac2aa5c795d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.766815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.767446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.767731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.768595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.769717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:55.771160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.772764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 219/445] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:55.773534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.783487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.784215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.784530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.784843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.834750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.855829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:55.857345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.882281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312121-3bd5-436f-97b2-1fee0976b1ca None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:55.884463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:55.915994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:55.916631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:55.916912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:55.917197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:55.917866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:55.918171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:55.919524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:55.927320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 220/446] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:55.928102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:55.960071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 227/447] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:55.960959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:56.026886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f2742-5919-4709-81da-2681c29b861e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.040154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:56.059304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.059637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc513a-73e4-4bd1-983c-f27e02ae9655 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.059910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.060193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.060503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.061230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=3a468bb5cd55417db77f4bb6f33b2817, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:56.061539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.062949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.069411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 221/448] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=3a468bb5cd55417db77f4bb6f33b2817 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:56.070193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:56.102216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.102844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.103128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.103405 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.107000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:56.187090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.187424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03fc4-f680-4cb2-b3f7-383e7812fea8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.188767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.229275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.229919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.230207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.230921 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] PATH_INFO: `/v3/projects/77a19a4d5b8742af8c2028ccba21a2db` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.231725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] RBAC: Authorizing `identity:get_project(project_id=77a19a4d5b8742af8c2028ccba21a2db)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.233205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.235465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 222/449] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:56 2022] GET /identity/v3/projects/77a19a4d5b8742af8c2028ccba21a2db => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:56.244148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:56.291725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:56.313076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 228/450] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:41:56.319634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:56.363518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:56.367541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11717d-3f30-43e9-9279-4f6f19f8e7b0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.405030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.405656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.405930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.406202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] PATH_INFO: `/v3/groups/0f888e1d45cc42b18b9af6accdce38da` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.407319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] RBAC: Authorizing `identity:get_group(group_id=0f888e1d45cc42b18b9af6accdce38da)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.408946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.410798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 223/451] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:56 2022] GET /identity/v3/groups/0f888e1d45cc42b18b9af6accdce38da => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:56.416647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:56.435037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7afb4-e3cd-4fb0-bcc7-d5ef12edf8b0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.468215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.468807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.469090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.469366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] PATH_INFO: `/v3/projects/99f84482a9b64bcfb8dae5485dc7545f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.470866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=99f84482a9b64bcfb8dae5485dc7545f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.474145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.475765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 229/452] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:41:56 2022] GET /identity/v3/projects/99f84482a9b64bcfb8dae5485dc7545f => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:56.481372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:56.518112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f360d48-79f8-4cc3-91cb-0ff2b4f8ee78 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.535130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:56.552852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.553459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.553745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.554023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.554753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] RBAC: Adding query filter params (group.id=0f888e1d45cc42b18b9af6accdce38da, role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=77a19a4d5b8742af8c2028ccba21a2db) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:56.555064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.556505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.562096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 224/453] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:56 2022] GET /identity/v3/role_assignments?group.id=0f888e1d45cc42b18b9af6accdce38da&scope.project.id=77a19a4d5b8742af8c2028ccba21a2db&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:56.587357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a911d27-1253-42af-8978-3bdec7e9e0f1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.624193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb602-61dc-447e-a190-0008fa0c9cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.624864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb602-61dc-447e-a190-0008fa0c9cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.625143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb602-61dc-447e-a190-0008fa0c9cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.625416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb602-61dc-447e-a190-0008fa0c9cc3 None admin] PATH_INFO: `/v3/groups/0bf7e2cd54ef4d668ef466725a34910b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.626549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb602-61dc-447e-a190-0008fa0c9cc3 None admin] RBAC: Authorizing `identity:get_group(group_id=0bf7e2cd54ef4d668ef466725a34910b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.628068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb602-61dc-447e-a190-0008fa0c9cc3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.629692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 230/454] 10.222.0.42 () {56 vars in 1180 bytes} [Wed Aug 24 08:41:56 2022] GET /identity/v3/groups/0bf7e2cd54ef4d668ef466725a34910b => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:41:56.635725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:56.667754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:56.739469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66809f-4150-4ef5-9508-cff430603c33 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:56.772837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222cb70-7f22-4065-9d40-ba7c2394dead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:56.773449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222cb70-7f22-4065-9d40-ba7c2394dead None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:56.773734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222cb70-7f22-4065-9d40-ba7c2394dead None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:56.774008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222cb70-7f22-4065-9d40-ba7c2394dead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:56.774741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222cb70-7f22-4065-9d40-ba7c2394dead None admin] RBAC: Adding query filter params (group.id=0bf7e2cd54ef4d668ef466725a34910b, role.id=759ce9628735416988d65affdc29c636, scope.project.id=99f84482a9b64bcfb8dae5485dc7545f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:41:56.775054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222cb70-7f22-4065-9d40-ba7c2394dead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:56.776514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222cb70-7f22-4065-9d40-ba7c2394dead None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:56.782333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 225/455] 10.222.0.42 () {56 vars in 1376 bytes} [Wed Aug 24 08:41:56 2022] GET /identity/v3/role_assignments?group.id=0bf7e2cd54ef4d668ef466725a34910b&scope.project.id=99f84482a9b64bcfb8dae5485dc7545f&role.id=759ce9628735416988d65affdc29c636 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:41:59.259866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e54c7-97f0-47b6-b0b4-211c3a1e829b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:59.261139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e54c7-97f0-47b6-b0b4-211c3a1e829b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:59.261619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e54c7-97f0-47b6-b0b4-211c3a1e829b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:59.263402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 231/456] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:59.270555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f5d3-26f7-4fdb-93b5-bc4eeffddc3a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:59.271420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f5d3-26f7-4fdb-93b5-bc4eeffddc3a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:59.271886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651f5d3-26f7-4fdb-93b5-bc4eeffddc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:59.294321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f651f5d3-26f7-4fdb-93b5-bc4eeffddc3a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:59.295881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f651f5d3-26f7-4fdb-93b5-bc4eeffddc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:59.375501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce00612-8acd-4ccb-b610-b8de852f3a37 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:59.375501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce00612-8acd-4ccb-b610-b8de852f3a37 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:59.375501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce00612-8acd-4ccb-b610-b8de852f3a37 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:59.376020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 232/457] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:41:59.381275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b381-0154-4648-bcb4-ddf24838e01d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:59.381570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b381-0154-4648-bcb4-ddf24838e01d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:59.381854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b381-0154-4648-bcb4-ddf24838e01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:59.390632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 226/458] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:41:59.412121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0c3a-62ca-441f-8d83-4bbd31954809 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:59.412467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0c3a-62ca-441f-8d83-4bbd31954809 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:59.412707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce0c3a-62ca-441f-8d83-4bbd31954809 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:59.414297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 227/459] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:41:59.419642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcdbd6-713c-43c1-be1e-c76a6c4bde6c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:59.420162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcdbd6-713c-43c1-be1e-c76a6c4bde6c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:59.420679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcdbd6-713c-43c1-be1e-c76a6c4bde6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:59.421945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b191b381-0154-4648-bcb4-ddf24838e01d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:59.423388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b191b381-0154-4648-bcb4-ddf24838e01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:59.457847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c2bcdbd6-713c-43c1-be1e-c76a6c4bde6c None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:41:59.459389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c2bcdbd6-713c-43c1-be1e-c76a6c4bde6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:41:59.508723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:59.547570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 233/460] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:59.584403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 228/461] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:41:59.657659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b381-0154-4648-bcb4-ddf24838e01d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:59.716401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:59.784660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b381-0154-4648-bcb4-ddf24838e01d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:59.827753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:41:59.828309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:41:59.828609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:41:59.828881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:41:59.839761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:41:59.841359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:41:59.843046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcdbd6-713c-43c1-be1e-c76a6c4bde6c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:41:59.860346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:41:59.861346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:41:59.865298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:41:59.865298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:41:59.865298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:41:59.865298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 234/462] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:41:59.867908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:41:59.984801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:41:59.987487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcdbd6-713c-43c1-be1e-c76a6c4bde6c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:41:59.989829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5a68f-b6ba-48dd-9424-e4b37e37e8b9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.023616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420b2d8-23fc-4217-be58-1db8d146bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.024245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420b2d8-23fc-4217-be58-1db8d146bb1c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.024628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420b2d8-23fc-4217-be58-1db8d146bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.024900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420b2d8-23fc-4217-be58-1db8d146bb1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.026427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.027147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.027526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.027812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.028488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:00.028800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.030216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.035266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420b2d8-23fc-4217-be58-1db8d146bb1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.036708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420b2d8-23fc-4217-be58-1db8d146bb1c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.046822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 235/463] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:00.046822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b420b2d8-23fc-4217-be58-1db8d146bb1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:00.053104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:00.053991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:00.054924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:00.054924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:00.054924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:00.054924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 229/464] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:00.055896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863d923-c00b-4d3d-beb2-6591f6f84880 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.055896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863d923-c00b-4d3d-beb2-6591f6f84880 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.055896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863d923-c00b-4d3d-beb2-6591f6f84880 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.057175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 230/465] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:00.057855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863d923-c00b-4d3d-beb2-6591f6f84880 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.069776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:00.156251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ac2e9-580d-40ad-89be-fcacf906b289 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.165478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863d923-c00b-4d3d-beb2-6591f6f84880 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.193599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.194228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.194529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.194768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.199843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a97d-4946-4b8d-8711-0941e0908e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.200492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a97d-4946-4b8d-8711-0941e0908e01 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.200782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a97d-4946-4b8d-8711-0941e0908e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.201061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a97d-4946-4b8d-8711-0941e0908e01 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.202128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a97d-4946-4b8d-8711-0941e0908e01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.203995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a97d-4946-4b8d-8711-0941e0908e01 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.205201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.206756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:00.224360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:00.225408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:00.229575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:00.229575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:00.229575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:00.229575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 236/466] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:00.229575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.229841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 231/467] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:42:00 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:00.229841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac2034-6b72-42a1-b9a4-3528b10d0922 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.229841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac2034-6b72-42a1-b9a4-3528b10d0922 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.229841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac2034-6b72-42a1-b9a4-3528b10d0922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.257814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:00.261648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f8ac2034-6b72-42a1-b9a4-3528b10d0922 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:00.263369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f8ac2034-6b72-42a1-b9a4-3528b10d0922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:00.338621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:00.353818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 232/468] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:00.355066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac2034-6b72-42a1-b9a4-3528b10d0922 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.422601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bcef0-cecc-426f-9356-da39a6479495 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.469224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.469866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.470150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.470426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.472037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:00.472347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.474309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.481760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac2034-6b72-42a1-b9a4-3528b10d0922 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.491662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 237/469] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:00.497257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.527525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.528949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.529371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.529925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.530812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:00.531484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.536845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.557970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 233/470] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:00.563225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.592930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:00.626291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:00.628484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84030-aa70-4fa7-8c5c-6e6eaed7a04f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.668815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.669723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.670201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.670672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.671505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.673335 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.690041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b67766-840a-481d-80ae-2b00443d276c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.699017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 238/471] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:42:00 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:42:00.700690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.730821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc45fd-4dde-4ce7-817b-e1f390d2a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.731444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc45fd-4dde-4ce7-817b-e1f390d2a331 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.731726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc45fd-4dde-4ce7-817b-e1f390d2a331 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.732050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc45fd-4dde-4ce7-817b-e1f390d2a331 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.732758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc45fd-4dde-4ce7-817b-e1f390d2a331 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.734352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc45fd-4dde-4ce7-817b-e1f390d2a331 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.763494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 234/472] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:42:00 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:42:00.829871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b24c9a-d691-41f8-ac86-477bae8770dd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:00.860263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf081-87c3-46c6-af17-c54f9471d245 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.860566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:00.860721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf081-87c3-46c6-af17-c54f9471d245 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.860905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cf081-87c3-46c6-af17-c54f9471d245 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.864900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 235/473] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:00.871005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a407-1bb9-441e-b964-7a9a3b3634c8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.871353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a407-1bb9-441e-b964-7a9a3b3634c8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.871644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a407-1bb9-441e-b964-7a9a3b3634c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.872281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:00.873281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:00.873760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:00.874290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:00.887950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:00.890198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:00.907216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:00.908168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:00.909169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:00.909169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:00.909169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:00.911283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 239/474] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:00.917168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:00.917586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8488a407-1bb9-441e-b964-7a9a3b3634c8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:00.918826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8488a407-1bb9-441e-b964-7a9a3b3634c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:01.007128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 236/475] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:01.038588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6fa78-73e2-4c1e-8a2a-be5031b3588c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:01.076110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:01.076747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:01.077027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:01.077297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:01.077939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:01.078239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:01.079616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:01.093036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 240/476] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:01.098841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a407-1bb9-441e-b964-7a9a3b3634c8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:01.140852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:01.213258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a407-1bb9-441e-b964-7a9a3b3634c8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:01.257824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:01.258776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:01.259284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:01.259751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:01.260621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:01.262244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:01.298129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 237/477] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:42:01 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:01.304605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:01.350399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:01.424682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d5048-15ba-4463-b4f1-c42a70bef0d6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:01.473297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:01.474340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:01.474888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:01.475358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:01.476235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:01.477973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:01.487297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.sql.core [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 08:42:01.487297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 08:42:01.487297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [parameters: {'id': '22707de43b8747259c668c7bb2cdbad6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 08:42:01.487297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81542) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 24 08:42:01.505011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 08:42:01.505969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application yield resource Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise self.value Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application session.commit() Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 08:42:01.506897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.flush() Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application compat.raise_( Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 08:42:01.507742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 08:42:01.509436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 08:42:01.511248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [parameters: {'id': '22707de43b8747259c668c7bb2cdbad6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:01.513274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 08:42:01.515419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:01.519731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 241/478] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 08:42:01 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:01.529569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:01.646180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:01.653200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36771cc2-2096-4aed-a806-86e3b6252a5c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:01.690677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baa9ea-3bfd-4a99-ac6b-516ca41b12b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:01.691334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baa9ea-3bfd-4a99-ac6b-516ca41b12b7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:01.691620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baa9ea-3bfd-4a99-ac6b-516ca41b12b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:01.691959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baa9ea-3bfd-4a99-ac6b-516ca41b12b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:01.702519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76baa9ea-3bfd-4a99-ac6b-516ca41b12b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-76baa9ea-3bfd-4a99-ac6b-516ca41b12b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:01.708509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:01.709401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:01.710202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 238/479] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:01.715427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:01.825901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf4062-6ea1-4453-8c72-752c237b1608 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:01.827378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:01.866735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4e01-4e9f-4adf-b007-7071e2b956cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:01.867438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4e01-4e9f-4adf-b007-7071e2b956cf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:01.867783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4e01-4e9f-4adf-b007-7071e2b956cf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:01.868122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4e01-4e9f-4adf-b007-7071e2b956cf None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:01.868887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4e01-4e9f-4adf-b007-7071e2b956cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:01.869258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4e01-4e9f-4adf-b007-7071e2b956cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:01.870690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4e01-4e9f-4adf-b007-7071e2b956cf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:01.879881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 242/480] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:02.726046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd54cf4-b41e-4199-a0ab-218a71d55509 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:02.726553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd54cf4-b41e-4199-a0ab-218a71d55509 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:02.726658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd54cf4-b41e-4199-a0ab-218a71d55509 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:02.728161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 239/481] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:02.733772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd99c-dc2c-45a6-a963-363d03c7f764 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:02.734204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd99c-dc2c-45a6-a963-363d03c7f764 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:02.734382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbd99c-dc2c-45a6-a963-363d03c7f764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:02.758505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-79cbd99c-dc2c-45a6-a963-363d03c7f764 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:02.759699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-79cbd99c-dc2c-45a6-a963-363d03c7f764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:02.848766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 243/482] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:42:03.106834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ddcfd-d575-4044-a9f0-86c8a7acf0b0 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.107170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ddcfd-d575-4044-a9f0-86c8a7acf0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.107340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ddcfd-d575-4044-a9f0-86c8a7acf0b0 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.108998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 240/483] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:03.114371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e74dc-7639-49aa-a8c1-89c8247b482d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.114666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e74dc-7639-49aa-a8c1-89c8247b482d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.114943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e74dc-7639-49aa-a8c1-89c8247b482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.136492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5d6e74dc-7639-49aa-a8c1-89c8247b482d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:03.137623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5d6e74dc-7639-49aa-a8c1-89c8247b482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:03.173894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292688-0a8c-4c91-a88a-0107172e301a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.174707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292688-0a8c-4c91-a88a-0107172e301a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.174977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66292688-0a8c-4c91-a88a-0107172e301a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.176570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 241/484] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:03.181364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb824f9-e288-4e29-ae60-76d1c50d0b4f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.181653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb824f9-e288-4e29-ae60-76d1c50d0b4f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.181933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb824f9-e288-4e29-ae60-76d1c50d0b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.213389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4bb824f9-e288-4e29-ae60-76d1c50d0b4f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:03.214603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4bb824f9-e288-4e29-ae60-76d1c50d0b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:03.235219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 244/485] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:03.268784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e74dc-7639-49aa-a8c1-89c8247b482d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:03.299347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:03.385219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e74dc-7639-49aa-a8c1-89c8247b482d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:03.394103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 242/486] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:03.426860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:03.427856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.428336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.428845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.445906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:03.450978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:03.451848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:03.452685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:03.455261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 245/487] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:03.461467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb824f9-e288-4e29-ae60-76d1c50d0b4f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:03.540613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:03.640830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:03.641924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:03.661700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8f55f-ea17-4211-9bf9-6982527b1d9e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:03.675019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb824f9-e288-4e29-ae60-76d1c50d0b4f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:03.699062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:03.699696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.699970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.700235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.711994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:03.716963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:03.717855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:03.718801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 246/488] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:03.725781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:03.748135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:03.749456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.749963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.750464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.751338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:03.751843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:03.753522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:03.766901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 243/489] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:03.768600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:03.854618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94500c8-6115-44f7-a8ec-e2bd96b0f5a8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:03.875881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a68d93-1bec-426a-8004-d82d097014cd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:03.897428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:03.897941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.898221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.898488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.899148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:03.899446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:03.900862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:03.917639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 247/490] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:03.917639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:03.922591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:03.923114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:03.925377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:03.926014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:03.926490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:03.939269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:03.945191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:03.946077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:03.946993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:03.949748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 244/491] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:03.950839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:03.962187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.038024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ffb2b-812f-4160-9975-673faf953703 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.061392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963a0d1-d874-436d-b32f-aeb59d2bc819 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.084261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.085031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.085309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.085581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.099165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.099795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.100431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.100915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.101284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.101641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.113996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.115844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:04.118052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:04.119063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:04.124787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:04.124787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:04.124787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:04.124787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 248/492] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:04.124787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:04.140080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:04.141115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:04.141966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:04.141966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:04.141966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:04.143792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 245/493] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:04.145098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.190937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.214790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.245451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cea7f-2db4-496c-91b1-c49348034a8d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.263679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be5e54-7d52-44df-afbc-56ff257961b8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.280553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.281168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.281453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.281727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.282387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:04.282694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.284756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.293249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 249/494] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:04.298464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.303372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06eaf-7682-453a-954b-4cd6e84a2809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.304256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06eaf-7682-453a-954b-4cd6e84a2809 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.304734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06eaf-7682-453a-954b-4cd6e84a2809 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.305197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06eaf-7682-453a-954b-4cd6e84a2809 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.306024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06eaf-7682-453a-954b-4cd6e84a2809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:04.306496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06eaf-7682-453a-954b-4cd6e84a2809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.308031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06eaf-7682-453a-954b-4cd6e84a2809 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.320231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 246/495] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:04.321929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace824a-b3f7-4799-8cee-71ee7370e4fb None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.322338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace824a-b3f7-4799-8cee-71ee7370e4fb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.322706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace824a-b3f7-4799-8cee-71ee7370e4fb None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.328297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 247/496] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:04.328297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace824a-b3f7-4799-8cee-71ee7370e4fb None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.410396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd2e66-f143-485a-be55-edc187256b44 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.431356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.436996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace824a-b3f7-4799-8cee-71ee7370e4fb None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.446107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.446659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.446944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.447221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.447865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:04.448173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.449617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.454385 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.462418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:04.463409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.476820 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b3f7-827e-4c62-96c6-f99a2829775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.477458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b3f7-827e-4c62-96c6-f99a2829775f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.477772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b3f7-827e-4c62-96c6-f99a2829775f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.478048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b3f7-827e-4c62-96c6-f99a2829775f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.488288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b3f7-827e-4c62-96c6-f99a2829775f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.489777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b3f7-827e-4c62-96c6-f99a2829775f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3db1b3f7-827e-4c62-96c6-f99a2829775f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:04.503919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:04.504863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:04.505725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:04.505725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:04.505725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:04.505725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:04.506269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82891cfd-81ec-4c7e-9451-6e7e57688246 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.506521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82891cfd-81ec-4c7e-9451-6e7e57688246 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.506773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82891cfd-81ec-4c7e-9451-6e7e57688246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.525086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-82891cfd-81ec-4c7e-9451-6e7e57688246 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:04.526287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-82891cfd-81ec-4c7e-9451-6e7e57688246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:04.565000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0bbbe-9212-489e-9335-dd78af2e96ac None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.592086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 249/499] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:04.593526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563abe-9cc8-4971-a905-54139a355a29 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.593822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563abe-9cc8-4971-a905-54139a355a29 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.594097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563abe-9cc8-4971-a905-54139a355a29 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.595607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 250/500] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:04.596408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563abe-9cc8-4971-a905-54139a355a29 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.608114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.608880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.609159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.609420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.617433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.618886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:04.631961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:04.632922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:04.633812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 251/501] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:04.634387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.676548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.704306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.709644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563abe-9cc8-4971-a905-54139a355a29 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.738578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c086c9-5b67-40dc-b3b4-5ff2e692b9cf None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.750416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de328bb9-0a3a-4a61-a773-c97491a3a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.751050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328bb9-0a3a-4a61-a773-c97491a3a0bc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.751425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328bb9-0a3a-4a61-a773-c97491a3a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.751603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de328bb9-0a3a-4a61-a773-c97491a3a0bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.758788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de328bb9-0a3a-4a61-a773-c97491a3a0bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.760531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de328bb9-0a3a-4a61-a773-c97491a3a0bc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.773406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-de328bb9-0a3a-4a61-a773-c97491a3a0bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:04.773547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:04.774428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:04.775475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:04.775986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.775986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.775986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.776155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 251/502] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:04.776220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9fe95-e04b-43a7-a05f-b399e6b4cbcc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.776924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9fe95-e04b-43a7-a05f-b399e6b4cbcc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.776924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9fe95-e04b-43a7-a05f-b399e6b4cbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.779875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:04.780199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.781607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.794986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 252/503] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:04.795804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.797040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-19c9fe95-e04b-43a7-a05f-b399e6b4cbcc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:04.798454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-19c9fe95-e04b-43a7-a05f-b399e6b4cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:04.865073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 252/504] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:04.866320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9fe95-e04b-43a7-a05f-b399e6b4cbcc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:04.905932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.909820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cc93-7fd6-4bed-9d08-7b07436b1ea6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.943942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:04.944588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:04.944869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:04.945143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:04.945878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:04.946186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:04.947663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:04.971772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:04.983849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9fe95-e04b-43a7-a05f-b399e6b4cbcc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:04.995511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 253/505] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:04.995511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.026447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.027081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.027351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.027616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.028337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:05.028665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.030287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.069588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 253/506] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:05.070423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.098313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ff698-35eb-42aa-adf0-bb1695e651e9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.135264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.135894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.136175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.136505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.145606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.147497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:05.160130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:05.161066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:05.161952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 254/507] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:05.162499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.173999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8969d-cdd7-4647-aaa9-a048546b67c5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.180915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.207709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.208336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.208647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.208923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.218832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:05.223780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:05.224691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:05.225507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 254/508] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:05.226162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.237684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.263417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af31a-e3a3-43ff-80c9-de06268daf15 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.296992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.297594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.297871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.298139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.325180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a79e5-5db9-424b-a682-6ecfe13d2d0a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.359398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.360004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.360287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.360597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.364450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.365909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.382883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.430190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.431763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.441879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.464544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 255/509] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:05.465386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.529198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 255/510] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:05.529972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.562517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74496184-3c0d-41ab-95b9-eeb52e5440a3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.581685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.598919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.599549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.599829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.600099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.609841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.611292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:05.625670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:05.628588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:05.629507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:05.629507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:05.629507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:05.629507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 256/511] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:05.629507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.633447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25032e7f-3172-442d-8b2b-b733f9e3c6dd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.643371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.667719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.668323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.668648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.668925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.669648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:05.669955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.671379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.687703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 256/512] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:05.688605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.731821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6ae2-1583-4b35-a574-427c0f39bb64 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.764761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.765364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.765650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.765927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.766586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:05.766893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.768344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.776762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 257/513] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:05.777861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.788112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414353f-6204-48b1-be41-d5fdc122bfd5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.811144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.822095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.822716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.823005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.823280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.833631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.835055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:05.850025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:05.850916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:05.851796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:05.851796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:05.851796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:05.851796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 257/514] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:05.852009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.869991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:05.880093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf4a4b-4358-4f4f-8979-e8f273680d1c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.914645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.915341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.915630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.915980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.926152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.927613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:05.941520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:05.942446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:05.943299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:05.943299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:05.943299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:05.943299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 258/515] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:05.943523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:05.954513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6201d73-7e4d-48cb-91cc-f7f9499ecf50 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:05.988483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:05.989100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:05.989385 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:05.989660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:05.990327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:05.990634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:05.992792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.004506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 258/516] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:06.005316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.028456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.045443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4189d8-799a-4c00-be63-956ca3062ba5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.078403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.079005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.079286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.079556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.085919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.107646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731f37a-c840-4095-bb17-2a8fff29eb9c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.141366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.141991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.142272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.142551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.146794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.148266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.152720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.154152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:06.168712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:06.169702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:06.170559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:06.170559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:06.170559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:06.170559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 259/517] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:06.170559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.235133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.251494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 259/518] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:06.252853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.274326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16473c-d2be-4f97-89f2-5bc0d265dd76 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.302015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.308104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.308748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.309030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.309302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.309940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:06.310244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.311612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.324145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 260/519] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:06.325039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.352000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787a9d8-912f-459b-a670-2bdb431953f4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.385843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782697f9-eac6-41ef-a113-84994996742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.386447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782697f9-eac6-41ef-a113-84994996742c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.386727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782697f9-eac6-41ef-a113-84994996742c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.387004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782697f9-eac6-41ef-a113-84994996742c None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.387641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782697f9-eac6-41ef-a113-84994996742c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:06.387946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782697f9-eac6-41ef-a113-84994996742c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.389625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782697f9-eac6-41ef-a113-84994996742c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.400696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 260/520] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:06.401485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782697f9-eac6-41ef-a113-84994996742c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.424924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3f308-cb5b-4299-be21-7ec18984fcd4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.447520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.459315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.459922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.460204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.460509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.461143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.462558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.482446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 261/521] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:42:06 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:06.496269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.520901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782697f9-eac6-41ef-a113-84994996742c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.536804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.564030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.564628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.564910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.565184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.565838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:06.566166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.567594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.582851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 261/522] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:06.583743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.615557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf21118-e343-42fb-8a54-6cb00c7b0ca0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.654570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.655438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.655850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.656127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.669305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.670747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:06.685958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:06.687075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:06.688044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:06.688044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:06.688044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:06.688044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 262/523] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:06.688044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.700652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c9449-17e9-4b9e-934c-f0bfce9e7f43 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.704324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.740665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.741577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.742187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.742516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.749647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.751317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:06.764818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:06.765739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:06.766744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 262/524] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:06.767217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.790371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:06.794995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2e5cc-11cf-4560-a862-b60f3a25e528 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.829436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.829992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.830795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.831071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.837752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.839178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:06.850699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:06.851609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 263/525] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:06.852964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.883711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d14863-944e-4793-8fe1-920e8a45440e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.923116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:06.923863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:06.924180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:06.924379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:06.932204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:06.933696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:06.945749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:06.946675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 08:42:06.947586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:06.951904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 263/526] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:06.957258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:06.970530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f73a2-9ca0-4375-b869-c8886aaf9729 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:06.983161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:07.007401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.008126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.008508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.008785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.009435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:07.009742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.011112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.023921 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 264/527] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:07.025387 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.047542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:07.068227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c342-ff34-4c7c-952b-686f49d6b830 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.102868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.103399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.103682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.103958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.104684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:07.104992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.106439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.129549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 264/528] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:07.129549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.135806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db83fed-3105-430e-91ba-bbe61602eec0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.171261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.171870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.172152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.172472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.173169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:07.173479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.174995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.194131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 265/529] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:07.199802 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.221940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:07.239121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40bf2-6078-4d1e-b635-c04d98b7e7d4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.279602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:07.283244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.284527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.284814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.285089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.285858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:07.286164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.287624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.303971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e96c-c3f8-4df0-a394-590502924a02 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.306643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 265/530] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:07.307261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.345003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.345642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.345989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.346267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.352987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.354400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:07.366035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:07.366864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:07.367712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 266/531] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:07.373022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.417797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664edec5-8906-4915-9b7a-fd08c693d5a7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.453308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.453918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.454203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.454479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.455725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=d8a1ec98c3264279822a7b46fc20ac94) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:07.456038 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.457534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.472158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 266/532] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/role_assignments?user.id=d8a1ec98c3264279822a7b46fc20ac94&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:07.472158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.479684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:07.493209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dccc0-4753-4472-b96d-623f9897f919 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.543923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.545257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.545550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.545831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.546818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=a517cf1b373445fd9e98c4e703732153) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:07.547140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.549966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.560561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 267/533] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/role_assignments?user.id=a517cf1b373445fd9e98c4e703732153&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:07.561868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.575226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:07.636979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e66d5-805e-4905-b1b7-650c596c855f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.711260 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.711878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.712163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.712439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.736775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74fcc6-62e0-4616-a7a3-0b15a2af8a6c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:07.805999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:07.807446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:07.808956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:07.809441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:07.811302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:07.811844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.815353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.839614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:07.843550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:07.846482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 268/534] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:07.848052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:07.864889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:07.973906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:08.043566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 267/535] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:08.045144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4455db-c59f-446a-8abb-de0e0bcb7491 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:08.053783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:08.112450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:08.113072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:08.113357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:08.113968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:08.114858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=bf830371223c4280902001e389cff3a6) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:08.115314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:08.116783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:08.124150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 269/536] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:07 2022] GET /identity/v3/role_assignments?user.id=bf830371223c4280902001e389cff3a6&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:08.257950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb587a3-4dc9-4dbf-8735-a396d27063c6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:08.271385 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:08.307792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a977979-cc2f-45a5-a973-49228315eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:08.308447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977979-cc2f-45a5-a973-49228315eb15 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:08.308730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977979-cc2f-45a5-a973-49228315eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:08.309001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a977979-cc2f-45a5-a973-49228315eb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:08.319537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a977979-cc2f-45a5-a973-49228315eb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:08.321193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a977979-cc2f-45a5-a973-49228315eb15 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5a977979-cc2f-45a5-a973-49228315eb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:08.342546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:08.343484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:08.344333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:08.344333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:08.344333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:08.344333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 268/537] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:08.353572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:08.468562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7f6e-32b5-4680-8fe9-b814954c50b5 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:08.468885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7f6e-32b5-4680-8fe9-b814954c50b5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:08.469126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed7f6e-32b5-4680-8fe9-b814954c50b5 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:08.471299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 269/538] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:08.476201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074c4d-a49d-4dea-9d49-4e318df3768c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:08.476434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49bae5-6f80-45fd-a174-08f44f756c82 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:08.476709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49bae5-6f80-45fd-a174-08f44f756c82 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:08.476992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49bae5-6f80-45fd-a174-08f44f756c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:08.505888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:08.508789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fb49bae5-6f80-45fd-a174-08f44f756c82 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:08.510099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fb49bae5-6f80-45fd-a174-08f44f756c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:08.515649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:08.516274 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:08.516599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:08.516882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:08.518444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:08.518767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:08.520155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:08.538105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 270/539] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:08.539363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:08.646377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67ebeb-45fa-4b26-bd04-30bea8767600 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:08.684839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:08.685483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:08.685767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:08.686044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:08.694477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:08.695958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:08.708848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:08.709916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:08.710978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:08.715063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 271/540] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:08.716239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:08.771706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:08.781406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 270/541] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:42:08.826476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7ee5f-c8fa-482c-8b7e-88b47714165e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:08.860943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:08.862081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:08.862366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:08.862647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:08.863353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:08.863667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:08.865191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:08.882407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 272/542] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:08.883823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49bae5-6f80-45fd-a174-08f44f756c82 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:09.011375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:09.028347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49bae5-6f80-45fd-a174-08f44f756c82 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:09.073965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:09.075332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.075838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.076309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.077253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=7194e3fe0d2d46ada270bb440cd79911) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:09.077763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:09.079407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:09.088650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 271/543] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:08 2022] GET /identity/v3/role_assignments?user.id=7194e3fe0d2d46ada270bb440cd79911&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:09.175285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:09.306211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c908b7e-ddde-45e8-8d29-2e0622d0973c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:09.314116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:09.346295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:09.346991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.347271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.347544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.363866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:09.373359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:09.374300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:09.375093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 273/544] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:09.380850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:09.500616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf4720-9fa3-4771-84c3-96d8e5c462c9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:09.536573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59821ac0-72b2-4e37-98b5-4dbd097c05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:09.537189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821ac0-72b2-4e37-98b5-4dbd097c05e5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.537476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821ac0-72b2-4e37-98b5-4dbd097c05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.537753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59821ac0-72b2-4e37-98b5-4dbd097c05e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.538422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59821ac0-72b2-4e37-98b5-4dbd097c05e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:09.538724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59821ac0-72b2-4e37-98b5-4dbd097c05e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:09.540100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59821ac0-72b2-4e37-98b5-4dbd097c05e5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:09.548775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 272/545] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:09.558461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:09.720406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882e5d2-6c0c-49e7-a2b0-1d505f48ed3d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:09.771826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:09.772491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.772780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.773055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.776286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed17d2-5fb2-40e9-bd75-cc29c4423aa9 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.776603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed17d2-5fb2-40e9-bd75-cc29c4423aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.776879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed17d2-5fb2-40e9-bd75-cc29c4423aa9 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.778490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 273/546] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:09.783742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6af2-9cef-4858-a8c0-2a1010b61c97 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.784288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6af2-9cef-4858-a8c0-2a1010b61c97 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.784909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b6af2-9cef-4858-a8c0-2a1010b61c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.792045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:09.793549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:09.804677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cf4b6af2-9cef-4858-a8c0-2a1010b61c97 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:09.806158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cf4b6af2-9cef-4858-a8c0-2a1010b61c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:09.816449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:09.817344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:09.818181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:09.818181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:09.818181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:09.818340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:09.818408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 274/547] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:09.823520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:09.873477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:09.882309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 274/548] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:09.903250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f88a63-76a5-4d5f-96df-e679b1495590 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.903565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f88a63-76a5-4d5f-96df-e679b1495590 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.903811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f88a63-76a5-4d5f-96df-e679b1495590 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.905442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 275/549] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:09.912475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc3642-6a0c-4698-854f-d9cfdb625b4f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:09.912764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc3642-6a0c-4698-854f-d9cfdb625b4f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:09.913046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc3642-6a0c-4698-854f-d9cfdb625b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:09.949498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-71dc3642-6a0c-4698-854f-d9cfdb625b4f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:09.950807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-71dc3642-6a0c-4698-854f-d9cfdb625b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:10.013339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91b140-494b-4f39-bdda-d9345a87f46f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.075351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.075911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.076192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.076566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.077680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:10.077975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:10.079627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:10.083111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 276/550] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:42:10.091936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 275/551] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:10.098169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc3642-6a0c-4698-854f-d9cfdb625b4f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:10.201964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:10.227280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:10.242594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc3642-6a0c-4698-854f-d9cfdb625b4f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.298339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.299437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.300155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.302164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.313897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:10.316963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:10.336566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:10.337980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:10.339040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:10.351328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 277/552] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:10.353595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:10.372075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:10.414484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f290b-472b-419b-877e-c90f3391553b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.460687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4497-57d3-49e0-a0d6-eb378731f837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.461388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4497-57d3-49e0-a0d6-eb378731f837 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.461671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4497-57d3-49e0-a0d6-eb378731f837 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.461947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4497-57d3-49e0-a0d6-eb378731f837 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.477416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4497-57d3-49e0-a0d6-eb378731f837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e98a4497-57d3-49e0-a0d6-eb378731f837 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:10.482183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:10.483106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:10.484110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:10.486161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9841f9c9-6914-48cf-a570-f906032fd2f6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.487998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 276/553] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:10.489698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8e0a-b8d8-47b8-882a-d13894c61707 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.489698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8e0a-b8d8-47b8-882a-d13894c61707 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.489953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8e0a-b8d8-47b8-882a-d13894c61707 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.495320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 277/554] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:10.497150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf18936-0c73-433e-bcac-33b3499a515b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.497449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf18936-0c73-433e-bcac-33b3499a515b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.497722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf18936-0c73-433e-bcac-33b3499a515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.517393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fdf18936-0c73-433e-bcac-33b3499a515b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:10.519127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fdf18936-0c73-433e-bcac-33b3499a515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:10.525391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.526006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.526288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.526798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.527306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:10.527614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:10.529084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:10.530869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:10.552467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 278/555] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:10.552467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:10.598475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 278/556] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:10.599659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf18936-0c73-433e-bcac-33b3499a515b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:10.683657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:10.687004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b9177-8a7b-43e2-9ea5-6c300b5a0a60 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.720190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf18936-0c73-433e-bcac-33b3499a515b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.735324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.737496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.737986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.738459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.739496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:10.740482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:10.742509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:10.758270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 279/557] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:10.758270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:10.771582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.773213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.773738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.774602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.790147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:10.797883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:10.798857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:10.800262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:10.801954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 279/558] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:10.803591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:10.825899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:10.880304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4edc75-0c24-4628-96a7-a19f8387eaab None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.920640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.921372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.921652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.922081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.925923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede8fc-5443-4bbf-a35f-111982ce686f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:10.954219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:10.962217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:10.962856 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:10.963139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:10.964116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:10.974698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:10.976910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:10.992154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:10.993186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:10.994058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:10.994058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:10.994058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:10.994058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 280/559] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:10.994058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.006057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.007760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.068938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.100739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b4661-c720-4ffe-87ac-e1a7f05e62c4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.123618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 280/560] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:11.124593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.150270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.150815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.151102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.151379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.152055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:11.152361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.153750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.166785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 281/561] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:11.166785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.208431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.234482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8902d2e-9f93-447f-920b-3c63213ef901 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.268137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24735d16-5826-410a-aa8f-5de9cea05bb1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.270336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.271040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.271327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.271598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.281880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:11.286828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:11.287759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:11.288640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 281/562] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:11.289786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.306995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.307599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.307884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.308158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.308845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:11.309147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.310528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.312109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.328191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 282/563] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:11.328191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.408760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858837cd-acb0-4602-805a-0f88a00ca738 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.426842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf95d2-bbbc-447c-986f-83bf82c393d4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.428349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.443163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.443795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.444078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.444357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.454864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.456433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.461791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.462660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.463073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.463461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:11.470418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:11.472396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:11.473635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:11.473635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:11.473635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:11.473635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 282/564] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:11.473635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.476256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.477836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:11.493103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:11.494181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:11.495064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:11.495064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:11.495064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:11.495064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 283/565] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:11.495064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.544852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.582099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900a530-0c47-4336-809b-f4f5e68066cf None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.596614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a765ae-c800-42e5-a57b-9a5eba16bc94 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.615160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e7d88-7d00-4564-9ae0-a503692fcb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.615769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7d88-7d00-4564-9ae0-a503692fcb3e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.616049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7d88-7d00-4564-9ae0-a503692fcb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.616321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7d88-7d00-4564-9ae0-a503692fcb3e None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.617014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7d88-7d00-4564-9ae0-a503692fcb3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:11.617317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7d88-7d00-4564-9ae0-a503692fcb3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.618689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e7d88-7d00-4564-9ae0-a503692fcb3e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.626529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 283/566] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:11.628023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d5c5-59f5-4736-bc3b-6f1b94989500 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.628309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d5c5-59f5-4736-bc3b-6f1b94989500 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.628611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593d5c5-59f5-4736-bc3b-6f1b94989500 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.629944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 284/567] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:11.630482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593d5c5-59f5-4736-bc3b-6f1b94989500 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.634574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.635245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.635530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.635810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.643748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.645214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:11.656003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:11.656970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:11.657925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 284/568] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:11.659114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.674261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.735925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593d5c5-59f5-4736-bc3b-6f1b94989500 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.759201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405d65e-38ef-4b8d-949f-0dfefebbd348 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.762283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.771089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.771709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.771984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.772267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.773957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:11.774263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.775631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.787383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 285/569] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:11.788166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.794562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5edbb2-dc0f-4d1e-9392-e786049657ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.795174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5edbb2-dc0f-4d1e-9392-e786049657ea None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.795455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5edbb2-dc0f-4d1e-9392-e786049657ea None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.795727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5edbb2-dc0f-4d1e-9392-e786049657ea None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.796375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5edbb2-dc0f-4d1e-9392-e786049657ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:11.796704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5edbb2-dc0f-4d1e-9392-e786049657ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.798073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5edbb2-dc0f-4d1e-9392-e786049657ea None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.809762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 285/570] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:11.810958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfafa-d2b1-4151-8041-767eddc26301 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.811248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfafa-d2b1-4151-8041-767eddc26301 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.811576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cfafa-d2b1-4151-8041-767eddc26301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.829407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-386cfafa-d2b1-4151-8041-767eddc26301 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:11.830668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-386cfafa-d2b1-4151-8041-767eddc26301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:11.886952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab7f2f-06bb-4a50-9fcc-ce91da00ff5b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:11.896334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 286/571] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:11.897371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cfafa-d2b1-4151-8041-767eddc26301 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:11.900276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:11.926298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:11.926932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:11.927219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:11.927494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:11.937867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:11.939324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:11.955161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:11.956118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:11.957117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:11.957117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:11.957117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:11.957117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 286/572] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:11.957338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.002636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.015420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cfafa-d2b1-4151-8041-767eddc26301 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.051271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.052100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.052591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.053038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.053904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:12.054363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.056015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.069635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f31706-2b8b-40b8-a829-296851efddca None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.074156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 287/573] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:12.075175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.110220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.110862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.111139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.111985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.119008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.120523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:12.132455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:12.133779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 287/574] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:12.134647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.146043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.186710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a618af-37e6-4145-90c1-fc6906cd13a1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.220468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.221634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.221916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.222186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.229254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.230683 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.236172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.240319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af32c5-6eaa-4de4-ba0e-a0e17c396136 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:12.242690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:12.243644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 288/575] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:12.244629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.277323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.277929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.278210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.278484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.279122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:12.279424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.280848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.292678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 288/576] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:12.293469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.342426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6bf9a-89ee-495e-b177-c790d4f6502c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.364955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.377272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.377894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.378172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.378458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.388499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.390055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bcb72-2276-46ac-8c01-95d6f97bd311 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.390188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:12.403983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:12.405943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:12.407846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:12.407846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:12.407846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:12.410451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 289/577] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:12.411028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.426611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.427225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.427508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.427781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.428499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:12.428835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.430370 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.442314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 289/578] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:12.443052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.468707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.512073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef582482-cafe-4436-945b-6a871cd66108 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.545174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.545882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.546240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.546361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f6c17-d811-42c0-a574-9b5f4ea8abbc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.546649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.557563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:12.562726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:12.563829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 290/579] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:12.565380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.586859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.587474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.587753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.588024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.588789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:12.589089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.590518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.600081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.608224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 290/580] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:12.609089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.671185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e32d-7765-4dc0-b71a-15e9007f2af2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.686378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.704099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.704818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.705727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.706010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.708964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6161f9-d41b-4062-bca0-0b1b06f77bc2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.713192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.714617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:12.725851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:12.726906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 291/581] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:12.727989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.748242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.748900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.749182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.749457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.750105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:12.750411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.751785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.762803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 291/582] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:12.763585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.818478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.825589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5e966-7ee4-4789-b84d-e3cd93824e34 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.859531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.860136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.860455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.860735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.861511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=7bb73a7c308340f48fc0106e96de3f7e) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:12.861824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.863242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.863873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0582f-8160-451e-aa6b-b4299e8573af None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:12.868477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 292/583] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/role_assignments?user.id=7bb73a7c308340f48fc0106e96de3f7e&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:12.869260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.913992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:12.914633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:12.914919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:12.915197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:12.915900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:12.916208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:12.917715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:12.923598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:12.932808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 292/584] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:12.932808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:12.995464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5113-40b0-4d07-9e6a-5c5e9ac49040 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.035630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.036267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.036595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.036878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.042484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67245376-789c-4947-8c2a-fb094bb0871d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.048219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.049725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:13.063742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:13.065289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:13.066178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:13.066178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:13.066178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:13.069973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 293/585] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:13.070782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.083858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.084013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.084783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.085073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.085662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.086415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:13.086722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.088225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.106828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 293/586] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 08:42:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:13.107660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.171935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.187228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c2202-8ffd-4fe9-ad7a-402d62e2b0d2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.214904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8f924-e7e9-4910-9605-69f6e3c79ed9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.223822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.224748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.225170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.225582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.232790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.234384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:13.246957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:13.247937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:13.249006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:13.249525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.249808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.250093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.250368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.251211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 294/587] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:13.252341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.265011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.266477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:13.281363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:13.287613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:13.288877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:13.288877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:13.288877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:13.288877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 294/588] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:13.288877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.337033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.371128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6caf7-b58b-4d94-915b-e246d0419a09 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.395823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942b7e7-0141-4f53-8d23-ce08b67e8d62 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.406074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.411105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.411824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.412016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.412254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.412931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:13.413233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.414589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.427534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 295/589] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:13.428421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.436346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.437012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.437299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.437597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.448196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.449711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:13.465050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:13.466027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:13.466921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:13.466921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:13.466921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:13.468316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 295/590] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:13.469251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.539461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48e71-967d-42d1-9fbd-e9ad687cb604 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.569575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.576487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.577496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.578558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.578900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.579891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:13.580541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.582307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.585669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60267baa-5e99-4033-b917-a18fe9158a99 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.594694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 296/591] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:13.595510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.628716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.629778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.630347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.630864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.632203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:13.632703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.634407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.653150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 296/592] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:13.653150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.676727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.705484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256d75a-bb73-4d8c-97b4-a4755aac19cd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.745068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.745947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.746377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.746647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.754272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.755684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.757402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975a8d6-6180-4469-ba49-2d7692b7c0a0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:13.767108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:13.768369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 297/593] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:13.769310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.800114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.800114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.800114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.800456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.801040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:13.801346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.802736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.820105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 297/594] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:13.820105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.832498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.888586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cea25e-41ea-4706-86ef-8382521ab24d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.912181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:13.927338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.928004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.928288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.928598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/d8a1ec98c3264279822a7b46fc20ac94/roles/d255dac55c5e4f468635e33a1d42d34a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.934290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe32c32-01e8-4a0a-97e1-a1c2b0d1d5bd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:13.947975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=d8a1ec98c3264279822a7b46fc20ac94, role_id=d255dac55c5e4f468635e33a1d42d34a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.949548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:13.972430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 298/595] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:13 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/d8a1ec98c3264279822a7b46fc20ac94/roles/d255dac55c5e4f468635e33a1d42d34a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:42:13.972430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:13.982196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:13.983001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:13.983352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:13.983748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:13.992774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:13.994581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:14.008044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:14.009274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 08:42:14.010395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:14.015475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 298/596] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:14.016450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.107466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:14.114552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e24789-5f92-455c-b5bb-8bddc77c6c40 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.145203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006f2e-e3b6-470c-802a-63a221f1176e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.159237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.159849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.160130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.160448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.161128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:14.161610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.162850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.178448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 299/597] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:14.179637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.189537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.190819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.191100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.191422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.209992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.211874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:14.225245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:14.226205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:14.227122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:14.229507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 299/598] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:14.230558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.233830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:14.288756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6d3da-a5f6-40ea-ab9e-ade338b3b6bf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.323352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.323971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.324260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.324561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.325294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:14.325607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.327037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.348643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 300/599] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 24 08:42:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:14.349497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.350471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0951c-0fbc-4645-80a0-47a6250f3ac5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.374632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:14.397696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.398601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.399049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.400033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/a517cf1b373445fd9e98c4e703732153/roles/d255dac55c5e4f468635e33a1d42d34a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.421397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=a517cf1b373445fd9e98c4e703732153, role_id=d255dac55c5e4f468635e33a1d42d34a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.423687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.444278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 300/600] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:14 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/a517cf1b373445fd9e98c4e703732153/roles/d255dac55c5e4f468635e33a1d42d34a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:42:14.445432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.514348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:14.530466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11e8c5-0a6e-41b2-9d53-da9120a9f018 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.594852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833417d-e8a0-4da6-9da7-a8beae1ddadf None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.624792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.625642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.626254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.627909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.628789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:14.629471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.633662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.647833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 301/601] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:14.656452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.675432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.676710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.677169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.677615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.693460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.695212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:14.724321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:14.725334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:14.726214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:14.726214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:14.726214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:14.735364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 301/602] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:14.741514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.788779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:14.836257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7506412-88ad-4605-80c7-63d18a8b37b0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.879794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c53d-cc63-46f6-ad54-23b430fc6927 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:14.882938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:14.892009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b2ad9-b8f6-45a7-85b6-b386af9cc129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.893226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2ad9-b8f6-45a7-85b6-b386af9cc129 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.893511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2ad9-b8f6-45a7-85b6-b386af9cc129 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.893791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2ad9-b8f6-45a7-85b6-b386af9cc129 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/bf830371223c4280902001e389cff3a6/roles/d255dac55c5e4f468635e33a1d42d34a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.908002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b2ad9-b8f6-45a7-85b6-b386af9cc129 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=bf830371223c4280902001e389cff3a6, role_id=d255dac55c5e4f468635e33a1d42d34a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.909671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b2ad9-b8f6-45a7-85b6-b386af9cc129 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.927285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 302/603] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:14 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/bf830371223c4280902001e389cff3a6/roles/d255dac55c5e4f468635e33a1d42d34a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:42:14.928678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502ce4-6d19-4598-8a29-ca457603b4ee None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.928965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502ce4-6d19-4598-8a29-ca457603b4ee None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.929240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e502ce4-6d19-4598-8a29-ca457603b4ee None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.929832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:14.930753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 303/604] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:14.930954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.931446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.931964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.933009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:14.933556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:14.935422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:14.945885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401ae2-3f17-4467-ab56-efc85d6d12d8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:14.946215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401ae2-3f17-4467-ab56-efc85d6d12d8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:14.946435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79401ae2-3f17-4467-ab56-efc85d6d12d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:14.950925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 302/605] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:14.957663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:14.989377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-79401ae2-3f17-4467-ab56-efc85d6d12d8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:14.991926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-79401ae2-3f17-4467-ab56-efc85d6d12d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:15.124411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 304/606] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:15.147428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b584dde-955f-414b-bce8-e594f7ab009f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:15.184008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:15.184692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:15.184974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:15.185248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:15.192593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:15.194089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:15.206563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:15.207510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:15.209251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 303/607] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:15.214478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79401ae2-3f17-4467-ab56-efc85d6d12d8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:15.287195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:15.339673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79401ae2-3f17-4467-ab56-efc85d6d12d8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:15.391194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:15.391814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:15.392099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:15.392504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:15.393217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:15.393530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:15.394958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:15.411759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 305/608] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:15.419286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:15.446660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:15.525578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9ca1-b3ae-4957-80af-112c94761fc3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:15.560644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:15.561325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:15.561607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:15.561879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/7194e3fe0d2d46ada270bb440cd79911/roles/d255dac55c5e4f468635e33a1d42d34a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:15.572134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:15.580703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=7194e3fe0d2d46ada270bb440cd79911, role_id=d255dac55c5e4f468635e33a1d42d34a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:15.581679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:15.604301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 304/609] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:15 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/7194e3fe0d2d46ada270bb440cd79911/roles/d255dac55c5e4f468635e33a1d42d34a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:42:15.709950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fbf70-9f10-41a0-9f48-ec8a6e865084 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:15.737472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:15.761713 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:15.762352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:15.762633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:15.762916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:15.779483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:15.784963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:15.785997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:15.786855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 306/610] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:15.792828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:15.899859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:15.927455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f442467-0bcd-42ff-8b86-7db25c1e2f31 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:15.962899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444beb5-26c9-484d-ade4-2dc161dca1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:15.963440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444beb5-26c9-484d-ade4-2dc161dca1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:15.963720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444beb5-26c9-484d-ade4-2dc161dca1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:15.963993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444beb5-26c9-484d-ade4-2dc161dca1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:15.964695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444beb5-26c9-484d-ade4-2dc161dca1a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:15.964998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444beb5-26c9-484d-ade4-2dc161dca1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:15.966391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444beb5-26c9-484d-ade4-2dc161dca1a1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:15.975383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 305/611] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:15.980755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:16.087426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667aa02-cbc6-4b0f-b56a-1ba748724323 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:16.122072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:16.122804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.123151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.123490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.129783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81475-6b7a-4720-822f-3db25582186c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.130156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81475-6b7a-4720-822f-3db25582186c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.130599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81475-6b7a-4720-822f-3db25582186c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.132287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 306/612] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:16.137543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739579-c303-45e6-bde1-bac86b5cbfcc None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.137937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739579-c303-45e6-bde1-bac86b5cbfcc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.138424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739579-c303-45e6-bde1-bac86b5cbfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.140813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:16.142983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:16.157671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c4739579-c303-45e6-bde1-bac86b5cbfcc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:16.159578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c4739579-c303-45e6-bde1-bac86b5cbfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:16.165150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:16.166269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:16.167337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:16.167337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:16.167337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:16.168799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 307/613] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:16.174609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:16.234092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 307/614] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:42:16.247760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:16.355351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6e816-e2c8-4de2-872b-7f16684e292c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:16.407574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:16.408556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.408989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.409410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.410204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:16.410688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:16.412192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:16.435187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 308/615] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:16.441050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739579-c303-45e6-bde1-bac86b5cbfcc None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:16.541816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:16.584072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739579-c303-45e6-bde1-bac86b5cbfcc None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:16.619137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:16.619940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.620378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.620815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.628346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:16.629840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:16.633789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:16.642176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:16.643659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:16.644711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:16.645745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 308/616] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:16.651509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:16.763778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e498ee-d21f-4119-90f7-c6bd1f264291 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:16.794594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:16.806647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db0ace-e509-4abb-a8d9-774b8a6644a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:16.807555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db0ace-e509-4abb-a8d9-774b8a6644a1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.808098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db0ace-e509-4abb-a8d9-774b8a6644a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.808594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db0ace-e509-4abb-a8d9-774b8a6644a1 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.810106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db0ace-e509-4abb-a8d9-774b8a6644a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:16.810622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db0ace-e509-4abb-a8d9-774b8a6644a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:16.812768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db0ace-e509-4abb-a8d9-774b8a6644a1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:16.832868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:16.834226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 309/617] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 24 08:42:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:16.839906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08a400-b5c4-49a8-ae54-4ae0c29b6733 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.840741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08a400-b5c4-49a8-ae54-4ae0c29b6733 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.841231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08a400-b5c4-49a8-ae54-4ae0c29b6733 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.842730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 310/618] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:16.843636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08a400-b5c4-49a8-ae54-4ae0c29b6733 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:16.844514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b6d76-b72f-491e-ae3c-22e0eca85964 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:16.881069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d016be1-fdf1-44d2-ac87-5d5c897e6889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:16.882040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d016be1-fdf1-44d2-ac87-5d5c897e6889 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.882569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d016be1-fdf1-44d2-ac87-5d5c897e6889 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.883051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d016be1-fdf1-44d2-ac87-5d5c897e6889 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.894774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d016be1-fdf1-44d2-ac87-5d5c897e6889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1d016be1-fdf1-44d2-ac87-5d5c897e6889 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:16.900019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:16.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:16.901955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:16.904153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 309/619] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:16.905640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c767999-667a-4e02-b87d-e27c85fcc437 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:16.906073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c767999-667a-4e02-b87d-e27c85fcc437 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:16.906488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c767999-667a-4e02-b87d-e27c85fcc437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:16.926163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7c767999-667a-4e02-b87d-e27c85fcc437 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:16.927817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7c767999-667a-4e02-b87d-e27c85fcc437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:16.979519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08a400-b5c4-49a8-ae54-4ae0c29b6733 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:16.999090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 310/620] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:17.000338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c767999-667a-4e02-b87d-e27c85fcc437 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.031748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.032673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.034646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.035239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.059732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.061439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:17.088952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:17.103710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:17.104708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:17.104708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:17.104708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:17.104708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 311/621] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:17.109735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.151031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:17.183120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:17.204437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c767999-667a-4e02-b87d-e27c85fcc437 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.256896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.257513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.257795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.258069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.258862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:17.259169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.260565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:17.270732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 311/622] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:17.276196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.320147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50d408-ce25-4a8b-ada8-b55002da8426 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.364847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105b10f-50e9-4978-8d18-3d2519cee2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.365647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105b10f-50e9-4978-8d18-3d2519cee2cc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.365932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105b10f-50e9-4978-8d18-3d2519cee2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.366218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105b10f-50e9-4978-8d18-3d2519cee2cc None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.366863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105b10f-50e9-4978-8d18-3d2519cee2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:17.367166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105b10f-50e9-4978-8d18-3d2519cee2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.368568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105b10f-50e9-4978-8d18-3d2519cee2cc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:17.380411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 312/623] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:17.381439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8da1-0b4b-4806-9086-cd3eb7739084 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.381729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8da1-0b4b-4806-9086-cd3eb7739084 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.382004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b8da1-0b4b-4806-9086-cd3eb7739084 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.383197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 313/624] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:17.385113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8da1-0b4b-4806-9086-cd3eb7739084 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.402269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651c975-52f5-4cc6-8fbc-ba226be773ab None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.440310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.441218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.441686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.442107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.453508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.455020 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:17.456877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:17.472732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:17.473693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:17.474583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:17.474583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:17.474583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:17.474583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 312/625] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:17.475139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.486041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:17.493895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b8da1-0b4b-4806-9086-cd3eb7739084 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.528897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f41a3-fb60-4e41-a720-6f780a6cb8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.529530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f41a3-fb60-4e41-a720-6f780a6cb8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.529807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f41a3-fb60-4e41-a720-6f780a6cb8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.530078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f41a3-fb60-4e41-a720-6f780a6cb8b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.541182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f41a3-fb60-4e41-a720-6f780a6cb8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-816f41a3-fb60-4e41-a720-6f780a6cb8b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:17.545917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:17.546833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:17.547687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 314/626] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:17.548448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf495-77fa-47aa-9ac6-db85dc6e964a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.549754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf495-77fa-47aa-9ac6-db85dc6e964a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.549754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf495-77fa-47aa-9ac6-db85dc6e964a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.568990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-101cf495-77fa-47aa-9ac6-db85dc6e964a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:17.570360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-101cf495-77fa-47aa-9ac6-db85dc6e964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:17.592748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245736b-77a8-4d81-969c-ef700e1954dd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.630841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.631754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.632042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.632510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.639751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.641230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:17.643893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 315/627] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:17.652623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cf495-77fa-47aa-9ac6-db85dc6e964a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:17.652951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:17.653862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 313/628] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:17.654836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.718719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:17.769705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bc00a-4349-420d-a040-27841ab55715 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.771098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:17.792112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cf495-77fa-47aa-9ac6-db85dc6e964a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.810390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.811260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.811727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.812268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.813252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:17.813758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.815331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:17.830708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 314/629] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:17.831941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.832253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.833053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.833369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.833743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.834494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:17.834899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.836598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:17.856475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 316/630] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:17.857670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:17.947991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6360edc-a6bf-4932-a123-e51644a3d754 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.965291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:17.978194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c03a4-b044-4c2d-8d81-0b3991bb68b8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:17.988227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:17.988874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:17.989159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:17.989742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:17.990729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:17.991042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:17.993026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.014527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 315/631] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:18.014527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.018283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.018927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.019209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.019479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.030685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.032610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.039768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:18.048513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:18.050209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:18.051295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:18.051295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:18.051295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:18.053260 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 317/632] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:18.054038 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.124841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af4eff-fa65-43e1-a12f-8a58c50b069f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.156199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83238c61-3e98-434b-9def-4f109d37ec72 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.160194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.160854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.161136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.161412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.168253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.169717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:18.180892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:18.182005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 316/633] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:18.183280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.194510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c6764-9893-43c2-8931-825a532de90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.195146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c6764-9893-43c2-8931-825a532de90d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.195430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c6764-9893-43c2-8931-825a532de90d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.195726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c6764-9893-43c2-8931-825a532de90d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.205827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c6764-9893-43c2-8931-825a532de90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-529c6764-9893-43c2-8931-825a532de90d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:18.210945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:18.212067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 318/634] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:18.213293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c6764-9893-43c2-8931-825a532de90d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.225638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:18.274730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:18.290132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac189a-2ea0-4aae-b64e-8ecd880cd57c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.317202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c6764-9893-43c2-8931-825a532de90d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.322598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec4083-7b2c-46b2-8651-2e436fd49f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.323245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4083-7b2c-46b2-8651-2e436fd49f9b None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.323516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4083-7b2c-46b2-8651-2e436fd49f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.323793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4083-7b2c-46b2-8651-2e436fd49f9b None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/7bb73a7c308340f48fc0106e96de3f7e/roles/d255dac55c5e4f468635e33a1d42d34a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.337972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec4083-7b2c-46b2-8651-2e436fd49f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=7bb73a7c308340f48fc0106e96de3f7e, role_id=d255dac55c5e4f468635e33a1d42d34a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.339434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec4083-7b2c-46b2-8651-2e436fd49f9b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.350775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.351392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.351755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.352029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.352398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 317/635] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:18 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/7bb73a7c308340f48fc0106e96de3f7e/roles/d255dac55c5e4f468635e33a1d42d34a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:42:18.364596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:18.364596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.364894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec908d-ef9b-41e0-be3e-d2d66e03b514 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.364894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec908d-ef9b-41e0-be3e-d2d66e03b514 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.364894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec908d-ef9b-41e0-be3e-d2d66e03b514 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.365143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.365231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 318/636] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:18.365231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec908d-ef9b-41e0-be3e-d2d66e03b514 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.369040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 319/637] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:18.369927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.468724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:18.488828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec908d-ef9b-41e0-be3e-d2d66e03b514 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.490696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a46d-3a09-4f46-bb40-7527b65d79ff None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.515452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:18.534437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461334c-b5f6-4ebc-9214-22c305c022e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.535399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461334c-b5f6-4ebc-9214-22c305c022e0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.535756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.536007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461334c-b5f6-4ebc-9214-22c305c022e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.536370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.536647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461334c-b5f6-4ebc-9214-22c305c022e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.536769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.536961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.537692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461334c-b5f6-4ebc-9214-22c305c022e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:18.537814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:18.538004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.538393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461334c-b5f6-4ebc-9214-22c305c022e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.539432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.540053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461334c-b5f6-4ebc-9214-22c305c022e0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.549383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 320/638] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:18.550779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418d058-1732-42e0-a4f7-e4feb8df2bc4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.551259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418d058-1732-42e0-a4f7-e4feb8df2bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.551674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418d058-1732-42e0-a4f7-e4feb8df2bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.561956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 319/639] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:18.562966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.570827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b418d058-1732-42e0-a4f7-e4feb8df2bc4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:18.572008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b418d058-1732-42e0-a4f7-e4feb8df2bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:18.641546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 321/640] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:18.652577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418d058-1732-42e0-a4f7-e4feb8df2bc4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.684846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63712-4190-4989-ba85-025e9cd2d03f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.732153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.732790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.733068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.733343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.745011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.747351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:18.766316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:18.767989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:18.769194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:18.769863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418d058-1732-42e0-a4f7-e4feb8df2bc4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.771682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 320/641] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:18.773543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.777279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:18.782384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:18.812455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.813242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.813622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.814001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.824770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:18.826367 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:18.842033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:18.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:18.844413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:18.844413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:18.844413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:18.845802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 322/642] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:18.846771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:18.905847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15875e-8ff6-44a6-b86a-bda407c89126 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.941888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:18.942634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:18.942920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:18.943193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:18.962413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afb5a6-8f3f-4354-a25b-8f4968b208ca None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:18.999086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.000046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.000572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.001109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.002578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:19.003086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.004785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.014959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.016373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.020229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.023831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 323/643] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:19.028422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.058898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.135478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 321/644] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:19.135478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.141671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef0bc-7827-4769-b572-6a138159d1b1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.178218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.179136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.179422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.179850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.180527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:19.180829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.182212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.194126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 324/645] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:19.195548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.242400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057d8f9-fbbb-4609-92d1-cfb217600758 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.244673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.276994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.277547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.277832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.278104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.288423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:19.293007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:19.293936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 322/646] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:19.294909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.302970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.327887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a9e10-b761-44aa-a09e-c452dfea743b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.365341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.365958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.366294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.366498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.402087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83013e1-757f-41cf-abb2-c0be51148ab5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.436451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.437111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.437397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.437678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.446723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.448234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.448920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.450360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:19.466374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:19.467334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:19.468214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:19.468214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:19.468214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:19.468214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 323/647] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:19.468893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.490694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.534463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.555116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 325/648] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:19.560581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.581663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d946200-a007-4e5f-8d40-5be132c8835d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.618696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.619459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.619848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.620246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.627680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.629224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:19.640574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:19.641677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:19.643313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:19.649454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 324/649] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:19.649454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.676815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4453a-74b0-4c8e-b78a-d789340a19cf None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.712828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.713523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.713873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.714228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.714972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:19.715336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.717097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.724499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.731365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 326/650] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:19.731365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.753947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ff1cf-615a-4be3-b88a-68f8bf0e444b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.781906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.790554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.791098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.791376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.791645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.792285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:19.792622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.793978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.806390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 325/651] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:19.807263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.847976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa004ed-d135-43ba-954a-a1a1a020fc62 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.883888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.884558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.884847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.885123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.896049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.897633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:19.912598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:19.914062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:19.915380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:19.915380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:19.915380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:19.915380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 327/652] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:19.915380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:19.924225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b50c9-6fe4-43ac-bb79-5556e17f2281 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:19.958922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:19.959534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:19.959824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:19.960099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:19.960973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:19.961281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:19.962831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:19.965484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:19.982970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 326/653] 10.222.0.42 () {56 vars in 1137 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:19.982970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.030862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.038483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a916ef-e298-4472-842a-7e2af6c0067b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.073199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.073760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.074044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.074324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.085109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.086566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.089715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb0b07-f1b1-4178-afad-fbc34c37f36a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:20.100959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:20.101897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:20.102822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:20.102822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:20.102822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:20.102822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 328/654] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:20.102822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.131985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.132650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.132934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.133207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.141190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.142078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:20.154858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:20.155769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:20.156741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 327/655] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:20.157257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.214625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b51a1b-8ce4-4d2c-8274-7eeec0c3e2a7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.217853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.252731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.253344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.253624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.253894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.254546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:20.254840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.256235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.268915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 329/656] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:20.269866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.271077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9f945-96fc-4155-a417-f8f3aaec3b30 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.278022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.305574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121db9-62bb-452b-9ab4-d88551058f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.306177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121db9-62bb-452b-9ab4-d88551058f53 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.306456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121db9-62bb-452b-9ab4-d88551058f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.306730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121db9-62bb-452b-9ab4-d88551058f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.367951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7f46f-36ea-4fde-96f2-3b2a58abbde7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.372515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7121db9-62bb-452b-9ab4-d88551058f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.373939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7121db9-62bb-452b-9ab4-d88551058f53 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.401724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.402326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.402607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.403097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.403511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:20.403816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.405206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.416628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 330/657] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:20.417420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.431058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.475341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 328/658] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:20.476378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9ec3-bb2f-44e4-825c-15d78e248435 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.476691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9ec3-bb2f-44e4-825c-15d78e248435 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.476964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de9ec3-bb2f-44e4-825c-15d78e248435 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.478731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 329/659] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:20.479286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9ec3-bb2f-44e4-825c-15d78e248435 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.484400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.520281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d487ae-9e3f-4cbc-8f88-955d1066c2c2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.556179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.556827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.557108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.557394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.558096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:20.558402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.559849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.571832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 331/660] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:20.573150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.585257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de9ec3-bb2f-44e4-825c-15d78e248435 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.619217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.619777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.620061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.620337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.627311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.628751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:20.639677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:20.640751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 330/661] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:20.646602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.659631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.675494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f62ffa-b1d1-4bce-b50a-d8f5159c98cc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.700872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.710128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb8965-86dc-4410-8cb4-5913f0992f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.710764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb8965-86dc-4410-8cb4-5913f0992f2d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.711044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb8965-86dc-4410-8cb4-5913f0992f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.711315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb8965-86dc-4410-8cb4-5913f0992f2d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.718146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb8965-86dc-4410-8cb4-5913f0992f2d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.719590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb8965-86dc-4410-8cb4-5913f0992f2d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-7cfb8965-86dc-4410-8cb4-5913f0992f2d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:20.731215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:20.732469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:20.733443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 332/662] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:20.734053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597a5ff-fe1a-47bd-87c1-28134ea718ed None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.734053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597a5ff-fe1a-47bd-87c1-28134ea718ed None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.734265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597a5ff-fe1a-47bd-87c1-28134ea718ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.749873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48739155-95ed-4949-87e7-d65586b83ed9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.752567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0597a5ff-fe1a-47bd-87c1-28134ea718ed None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:20.753857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0597a5ff-fe1a-47bd-87c1-28134ea718ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:20.783943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.784637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.784943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.785216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.795917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.797393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:20.811118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:20.812224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:20.813170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:20.813170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:20.813170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:20.813170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 331/663] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:20.813402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.823865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 333/664] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:20.824592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597a5ff-fe1a-47bd-87c1-28134ea718ed None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.886267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.925433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868bebe-c306-422d-ab07-68c12858b542 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.938004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597a5ff-fe1a-47bd-87c1-28134ea718ed None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:20.956550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:20.963092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.964028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.964480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.964881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.965770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=d8a1ec98c3264279822a7b46fc20ac94) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:20.966088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.968110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.974815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 332/665] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/role_assignments?user.id=d8a1ec98c3264279822a7b46fc20ac94&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:20.975338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:20.975625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:20.976397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:20.976747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:20.977087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:20.977845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:20.978232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:20.979752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:20.996556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 334/666] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:20.997821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.102377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30947b-994a-4cda-b9b3-572e71be7353 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.141615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:21.142549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4f41d-0b5c-4c92-a746-e26d4ff6b688 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.148308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.148948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.149234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.149511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.150247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:21.150551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.151993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.170298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 333/667] 10.222.0.42 () {56 vars in 1139 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:21.170980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.183670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.184288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.184597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.184890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.185533 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:21.185829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.187209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.200174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 335/668] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:21.201147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.239739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:21.297313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c97681-f9f3-4310-937b-1687dad0bb73 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.308250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4febe7-0e7b-4016-84ca-8c1c0c89990e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.334943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.335558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.335846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.336123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.336889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=a517cf1b373445fd9e98c4e703732153) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:21.337207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.338632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.344073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.352661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 334/669] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/role_assignments?user.id=a517cf1b373445fd9e98c4e703732153&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:21.352865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.352865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.352865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.353125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.366481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:21.373611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:21.375065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:21.376109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 336/670] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:21.377669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.416937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:21.474595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970aa3c-d4b7-4617-9f52-d40aeb519ced None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.503163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:21.510422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0df7d-eb5d-4f50-b429-1b4943485b36 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.521571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.522550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.522989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.523414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.554276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.555200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.555727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.556163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.563414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.565653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:21.582901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:21.583789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:21.584838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 337/671] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:21.585364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.607023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.608731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.673021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:21.714109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc77085-1129-4ed1-9c60-b68254e2c153 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.731478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 335/672] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:21.731478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.759244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.760272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.760793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.761271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.762141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:21.762750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.764802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.773923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 338/673] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:21.775085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.804767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:21.843887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca5cdd-08db-4756-b897-9a5e86af940b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.885317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.886222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.886663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.887335 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.888676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:21.889391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.891493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.908957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 336/674] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:21.909161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaf2b7-af5f-4d95-8555-51baa3d81dce None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:21.910194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:21.932839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:21.951578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:21.952671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:21.953102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:21.953429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:21.965356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:21.966980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:21.981519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:21.982691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:21.983806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:21.983806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:21.983806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:21.984883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 339/675] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:21.986142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.022557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1bd40-4253-4286-aeef-e01808ce236d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.058045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.058784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.059068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.062653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:22.073308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.075103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:22.091349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:22.092561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:22.093616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:22.093616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:22.093616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:22.095301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 337/676] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:22.096243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.101676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1d306-0902-4e31-b830-864b4fe1e23d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.139168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.139783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.140064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.140444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.141171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=bf830371223c4280902001e389cff3a6) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:22.141478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.143094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.156568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 340/677] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:21 2022] GET /identity/v3/role_assignments?user.id=bf830371223c4280902001e389cff3a6&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:22.157800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.166237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:22.209608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd8e2-949b-4957-bed4-432234e968a3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.246539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.247192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.247476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.247804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.248484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:22.248793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.250171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.264869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 338/678] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:22.271715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.386060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624a76-99cb-4f43-9af1-280f94351fef None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.408594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057daf2c-e887-4e3f-a383-e8b00edc8cfe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.433261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:22.433742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.435291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.436278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.437328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.438165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:22.438651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.440699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.443187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:22.446802 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.447441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.447719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.447991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.456994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.458480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.463744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 341/679] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:22.465479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:22.471655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:22.472588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:22.474735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 339/680] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:22.478800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.583061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15fd30-e646-40eb-b4ae-766ad8c10f7e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.583257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58afb0-5c96-4d70-8136-b40956892048 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.619220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.619431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.619663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.619873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.620619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:22.621192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.622679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.625510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.626456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.627526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.628013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.636129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.637285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 340/681] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:22.639928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.643855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:22.654048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:22.655020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:22.655985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:22.663214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 342/682] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:22.664734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.697530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:22.743577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:22.776581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243061-c2c7-46d0-9c40-5fcac405e594 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.803462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffdc200-ccc1-4999-81b6-b47e70f9f58d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:22.842709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.843697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.844142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.844597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.846017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:22.846471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.848050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.860471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ada9f-28d8-47bf-b860-8474ad7a6a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:22.861710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ada9f-28d8-47bf-b860-8474ad7a6a2f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:22.861997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ada9f-28d8-47bf-b860-8474ad7a6a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:22.862272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ada9f-28d8-47bf-b860-8474ad7a6a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:22.863012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ada9f-28d8-47bf-b860-8474ad7a6a2f None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=7194e3fe0d2d46ada270bb440cd79911) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:22.863323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ada9f-28d8-47bf-b860-8474ad7a6a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:22.869336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 343/683] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:22.872846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ada9f-28d8-47bf-b860-8474ad7a6a2f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:22.876418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:22.883054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 341/684] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/role_assignments?user.id=7194e3fe0d2d46ada270bb440cd79911&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:23.031988 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8bbfa-9ab2-4033-90e2-3ec3643968e3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:23.049226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:23.072144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:23.072815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.073100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.073379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.147245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:23.148821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:23.209375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5091d7-d278-4fdf-a1c3-0df0f4a1ee35 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.209660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5091d7-d278-4fdf-a1c3-0df0f4a1ee35 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.209943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5091d7-d278-4fdf-a1c3-0df0f4a1ee35 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.211514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 342/685] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:23.216855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5cb0-f4bb-4614-8cef-c645f454b039 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.217143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5cb0-f4bb-4614-8cef-c645f454b039 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.217425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef5cb0-f4bb-4614-8cef-c645f454b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.239309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cfef5cb0-f4bb-4614-8cef-c645f454b039 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:23.240564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cfef5cb0-f4bb-4614-8cef-c645f454b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:23.259920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 344/686] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:23.265433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:23.284866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:23.338867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 343/687] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:42:23.424150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbc586-b866-44fb-9390-6d214adc1498 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:23.469640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:23.470341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.470665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.470979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.481978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:23.483502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:23.504172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:23.505278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:23.506248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:23.506248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:23.506248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:23.506248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 345/688] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:23.511079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5cb0-f4bb-4614-8cef-c645f454b039 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:23.553569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:23.619111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef5cb0-f4bb-4614-8cef-c645f454b039 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:23.654625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:23.655245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.655590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.655871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.656552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:23.656986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:23.658924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:23.671159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 344/689] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:23.676587 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:23.687507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:23.800314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:23.845281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:23.850360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a31d5-22af-4ccb-960d-0be6566803d5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:23.855955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1d656-1521-4ba4-b174-509ceacff1c6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:23.888664 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59060-7bf3-4b59-86b1-1a3615705b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:23.889931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59060-7bf3-4b59-86b1-1a3615705b6b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.890522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59060-7bf3-4b59-86b1-1a3615705b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.891094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59060-7bf3-4b59-86b1-1a3615705b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.891905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff7bbd-ba4d-4026-ba4e-4629d6421eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:23.893101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7bbd-ba4d-4026-ba4e-4629d6421eea None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.893386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7bbd-ba4d-4026-ba4e-4629d6421eea None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.893661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff7bbd-ba4d-4026-ba4e-4629d6421eea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.900611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff7bbd-ba4d-4026-ba4e-4629d6421eea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:23.902069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff7bbd-ba4d-4026-ba4e-4629d6421eea None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:23.904791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59060-7bf3-4b59-86b1-1a3615705b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:23.906445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59060-7bf3-4b59-86b1-1a3615705b6b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-c8ff7bbd-ba4d-4026-ba4e-4629d6421eea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:23.913514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:23.914430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:23.915333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 346/690] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:23.916260 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807338-38a2-4c3b-8159-884dc4000393 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.916366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807338-38a2-4c3b-8159-884dc4000393 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.916607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd807338-38a2-4c3b-8159-884dc4000393 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.922054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 347/691] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:23.922054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd807338-38a2-4c3b-8159-884dc4000393 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8bf59060-7bf3-4b59-86b1-1a3615705b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:23.930103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:23.931052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:23.931960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:23.931960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:23.931960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:23.934145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 345/692] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:23.935626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383695-7d23-4f06-a45f-2770e459175a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:23.936126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383695-7d23-4f06-a45f-2770e459175a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:23.936630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e383695-7d23-4f06-a45f-2770e459175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:23.956669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2e383695-7d23-4f06-a45f-2770e459175a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:23.958517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2e383695-7d23-4f06-a45f-2770e459175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:24.037933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 346/693] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:24.037933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e383695-7d23-4f06-a45f-2770e459175a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:24.040995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd807338-38a2-4c3b-8159-884dc4000393 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:24.084996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:24.104769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:24.105544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.105829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.107347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.107623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:24.107934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:24.109412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:24.135190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 348/694] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:24.139966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:24.184847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:24.222375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e383695-7d23-4f06-a45f-2770e459175a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:24.289979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:24.290612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.290893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.291171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.291830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:24.292135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:24.293862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:24.315574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 347/695] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:24.327308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca46a-9550-496c-b3d8-e07162dd5227 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:24.331369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:24.373747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:24.373747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.373747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.373747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.374189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=7bb73a7c308340f48fc0106e96de3f7e) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:24.374189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:24.374189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:24.379071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 349/696] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:24 2022] GET /identity/v3/role_assignments?user.id=7bb73a7c308340f48fc0106e96de3f7e&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:24.400291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:24.457494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:24.468459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff99d2-c29b-4f56-8d10-9ccdf4f06616 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:24.509830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:24.510917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.511371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.512307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.513160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:24.515175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:24.518737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651937b5-b597-4990-86e0-4090f77673e6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:24.527775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:24.543411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 348/697] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:42:24 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:42:24.590027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdbc0d-e17f-43aa-a88a-0adcc4ac6bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:24.590788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbc0d-e17f-43aa-a88a-0adcc4ac6bae None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.591171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbc0d-e17f-43aa-a88a-0adcc4ac6bae None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.591536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdbc0d-e17f-43aa-a88a-0adcc4ac6bae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.605221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdbc0d-e17f-43aa-a88a-0adcc4ac6bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-c7bdbc0d-e17f-43aa-a88a-0adcc4ac6bae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:24.610604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:24.612158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:24.613042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 350/698] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:24.618778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:24.658227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be71c-6b3f-441b-8ac3-0272edc686ed None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.658431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be71c-6b3f-441b-8ac3-0272edc686ed None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.658719 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be71c-6b3f-441b-8ac3-0272edc686ed None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.660315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 351/699] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:24.666535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5605e-7888-4bc4-b0c2-6102db960e31 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.666919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5605e-7888-4bc4-b0c2-6102db960e31 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.667277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5605e-7888-4bc4-b0c2-6102db960e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.688939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c9a5605e-7888-4bc4-b0c2-6102db960e31 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:24.690347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c9a5605e-7888-4bc4-b0c2-6102db960e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:24.747665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7984f-6d64-421b-a846-f1200e1f3c72 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:24.771757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 352/700] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:24.792337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:24.793083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.793374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.793654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.794338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:24.794646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:24.796012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:24.805460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 349/701] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:24.811005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5605e-7888-4bc4-b0c2-6102db960e31 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:24.859594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:24.927867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5605e-7888-4bc4-b0c2-6102db960e31 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:24.964504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:24.965348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:24.965729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:24.966120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:24.977404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:24.978985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:24.994250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:24.995418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:24.996575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:24.996575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:24.996575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:24.997937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 353/702] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:25.004045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:25.059255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:25.078081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:25.174980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:25.175179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff242274-822d-40a4-b22b-ae60e7cca1b4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:25.186659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199d322-8b6d-4cd0-9a16-478632b7adf8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:25.223980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:25.225139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.225626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.226120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.226929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:25.228678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:25.241384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:25.242607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:25.243643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:25.246750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 354/703] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 24 08:42:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:25.253284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:25.266115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:25.266476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.266674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.266949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.267704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:25.268010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:25.269425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:25.295943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 350/704] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:25.301829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:25.373712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d82745-0ee3-4cde-a9b2-74d98100cc07 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:25.411968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0e573-f6bd-467c-9c8e-345d529aa0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:25.413066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0e573-f6bd-467c-9c8e-345d529aa0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.413609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0e573-f6bd-467c-9c8e-345d529aa0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.414101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0e573-f6bd-467c-9c8e-345d529aa0b1 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.415049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0e573-f6bd-467c-9c8e-345d529aa0b1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:25.415586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0e573-f6bd-467c-9c8e-345d529aa0b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:25.417224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0e573-f6bd-467c-9c8e-345d529aa0b1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:25.422649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 355/705] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 08:42:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:25.424753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab937f-0731-43c9-a431-20fafd9e6b2a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.425248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab937f-0731-43c9-a431-20fafd9e6b2a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.425741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab937f-0731-43c9-a431-20fafd9e6b2a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.427522 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 356/706] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:25.428468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab937f-0731-43c9-a431-20fafd9e6b2a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:25.448435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:25.470346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96de08-70d3-4d62-9cf3-091d8fbe3ac0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:25.488880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:25.507208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb3a7b-3810-4f16-a71c-eb91c66cfa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:25.507435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb3a7b-3810-4f16-a71c-eb91c66cfa32 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.507656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb3a7b-3810-4f16-a71c-eb91c66cfa32 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.507853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb3a7b-3810-4f16-a71c-eb91c66cfa32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.515917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb3a7b-3810-4f16-a71c-eb91c66cfa32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:25.517966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb3a7b-3810-4f16-a71c-eb91c66cfa32 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-baeb3a7b-3810-4f16-a71c-eb91c66cfa32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:25.530984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:25.531956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:25.533026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:25.536773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 351/707] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:42:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:25.538088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6157-3705-42b1-a182-1855c70dea4d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.538372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6157-3705-42b1-a182-1855c70dea4d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.538646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6157-3705-42b1-a182-1855c70dea4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.546174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab937f-0731-43c9-a431-20fafd9e6b2a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:25.556940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ce7c6157-3705-42b1-a182-1855c70dea4d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:25.558221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ce7c6157-3705-42b1-a182-1855c70dea4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:25.595165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:25.596239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.596772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.597274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.598138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:25.598642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:25.600234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:25.606708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 357/708] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 08:42:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:25.607766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:25.657313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:25.708870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:25.723286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fec1f-d2d2-446e-85b3-5dfb2f94b88c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:25.779169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:25.779808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.780098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.780372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:25.781145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:25.781456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:25.783516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:25.816712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 358/710] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:42:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:25.822219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6157-3705-42b1-a182-1855c70dea4d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:25.946327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6157-3705-42b1-a182-1855c70dea4d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:25.958266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:25.998130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:25.998663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:25.998947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:25.999222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.022183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:26.140439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:26.144264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:26.222417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6734831-949a-457e-944c-b32b6ed5fe61 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:26.295708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:26.296746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:26.297057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:26.297341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.297952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:26.301621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:26.318440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:26.319485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:26.320297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:26.327216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 359/711] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:26 2022] GET /identity/v3/services/network => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:26.328077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:26.339912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 353/712] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 08:42:26.340084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:26.346206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:26.366716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:26.487700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc8590-f96b-4ae3-b822-166ddd6601ab None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:26.524708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:26.526199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:26.526509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:26.526729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.538833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:26.540301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:26.556855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:26.557889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:26.558776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:26.558776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:26.558776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:26.558776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 354/713] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:26.563535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:26.600881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a06dca-031d-45a6-b16d-43f4c1bc54a2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:26.672328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:26.674100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:26.674572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:26.675023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.675831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] RBAC: Adding query filter params (name=network) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:26.676318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:26.678067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:26.683521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 360/714] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:26.688555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:26.699104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:26.792232 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd2389-3e0c-40d1-a18f-4714db78e53d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:26.800732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:26.860546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763c5e-3d37-4407-9acc-b04e30d1fe55 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:26.867167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:26.868113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:26.868652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:26.869172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.870048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:26.870552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:26.872118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:26.885411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 355/715] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:26.891576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:26.937096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a04dc0-c321-42fe-985c-b3b1132edf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:26.937720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04dc0-c321-42fe-985c-b3b1132edf56 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:26.938008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04dc0-c321-42fe-985c-b3b1132edf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:26.938309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a04dc0-c321-42fe-985c-b3b1132edf56 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.939999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a04dc0-c321-42fe-985c-b3b1132edf56 None admin] RBAC: Adding query filter params (type=network) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:26.940308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a04dc0-c321-42fe-985c-b3b1132edf56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:26.942475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a04dc0-c321-42fe-985c-b3b1132edf56 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:26.949308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 361/716] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:26.950591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68ecf-4312-453f-8f08-ace6db735712 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:26.950879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68ecf-4312-453f-8f08-ace6db735712 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:26.951209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee68ecf-4312-453f-8f08-ace6db735712 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.956528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 362/717] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:26.960228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc864-e7b4-45e1-9315-b939d1c9d7c9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:26.962022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc864-e7b4-45e1-9315-b939d1c9d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:26.963171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bc864-e7b4-45e1-9315-b939d1c9d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:26.982693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-702bc864-e7b4-45e1-9315-b939d1c9d7c9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:26.984006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-702bc864-e7b4-45e1-9315-b939d1c9d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:27.021068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731713c8-052f-4a41-b3a7-4ebc697991ab None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:27.051461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:27.068337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:27.069067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.069352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.069624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.077573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:27.079056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:27.094214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:27.095735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:27.096672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:27.097448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 363/719] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:42:27.104416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 356/719] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:27.104416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:27.104900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81450de3-4ab5-492c-8f32-d8215592cfb2 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.105196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81450de3-4ab5-492c-8f32-d8215592cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.105476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81450de3-4ab5-492c-8f32-d8215592cfb2 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.107246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 364/720] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:27.114235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce172ae-1d6a-4b77-a0b9-c051e9898e66 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.114468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce172ae-1d6a-4b77-a0b9-c051e9898e66 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.114713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce172ae-1d6a-4b77-a0b9-c051e9898e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.136172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cce172ae-1d6a-4b77-a0b9-c051e9898e66 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:27.137398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cce172ae-1d6a-4b77-a0b9-c051e9898e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:27.214993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:27.237117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 365/721] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 08:42:27.290640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fd8b0-d959-4f69-8172-56722ef371fd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:27.341116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:27.341727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.342004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.342277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.342978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:27.343282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:27.344719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:27.358356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 357/722] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:27.364900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce172ae-1d6a-4b77-a0b9-c051e9898e66 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:27.385100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:27.437411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:27.500950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce172ae-1d6a-4b77-a0b9-c051e9898e66 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:27.562916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:27.563543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.563824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.564665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.565409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=a517cf1b373445fd9e98c4e703732153) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:27.565721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:27.567181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:27.571123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cea55e-9380-4328-8c7d-bd2691af6f51 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:27.591852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 366/723] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:27 2022] GET /identity/v3/role_assignments?user.id=a517cf1b373445fd9e98c4e703732153&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:27.613359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:27.614054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.614338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.614614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.627994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:27.632938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:27.633920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:27.634783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:27.639471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 358/724] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:27.640983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:27.649476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:27.759938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:27.823686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb765e-a25b-409d-b742-06d0e3a0c96c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:27.824680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:27.828163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee95f2-8229-45c6-a48a-9f4d3d19eabf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:27.863471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:27.864650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.866432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.867708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.871223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:27.871712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:27.873512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:27.888606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 367/725] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:27.897430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:27.910006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:27.911028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:27.911028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:27.911308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:27.937370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:27.942824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:27.944018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:27.945189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 359/726] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:27.951471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.050600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f351e-ff65-4107-8827-4cf029898637 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:28.079315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:28.080295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf52e8-28c5-4011-8468-c3c25f422d7d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:28.098702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb4395-3c3f-4134-9c15-a3bc9ab10834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:28.099353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4395-3c3f-4134-9c15-a3bc9ab10834 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.099638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4395-3c3f-4134-9c15-a3bc9ab10834 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.099917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb4395-3c3f-4134-9c15-a3bc9ab10834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.112741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb4395-3c3f-4134-9c15-a3bc9ab10834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:28.114218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb4395-3c3f-4134-9c15-a3bc9ab10834 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:28.128766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479a471-e99b-415f-8fa5-9eddcb63f92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fafb4395-3c3f-4134-9c15-a3bc9ab10834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:28.129014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:28.129970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:28.130871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:28.130871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:28.130871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:28.132275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479a471-e99b-415f-8fa5-9eddcb63f92d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.132801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479a471-e99b-415f-8fa5-9eddcb63f92d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.133238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479a471-e99b-415f-8fa5-9eddcb63f92d None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.134068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479a471-e99b-415f-8fa5-9eddcb63f92d None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:28.134557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479a471-e99b-415f-8fa5-9eddcb63f92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:28.134746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 368/727] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:28.136082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c844-a365-4db4-a540-ab7b3e341a76 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.136372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c844-a365-4db4-a540-ab7b3e341a76 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.136586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479a471-e99b-415f-8fa5-9eddcb63f92d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:28.136693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c844-a365-4db4-a540-ab7b3e341a76 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.138198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 369/728] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:28.139228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c844-a365-4db4-a540-ab7b3e341a76 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.152866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 360/729] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:28.156825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034df04-3af9-4ddd-ac18-d67a70cbc556 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.157286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034df04-3af9-4ddd-ac18-d67a70cbc556 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.158219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034df04-3af9-4ddd-ac18-d67a70cbc556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.185340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d034df04-3af9-4ddd-ac18-d67a70cbc556 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:28.187639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d034df04-3af9-4ddd-ac18-d67a70cbc556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:28.210763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:28.255390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c844-a365-4db4-a540-ab7b3e341a76 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:28.281365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 361/730] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:28.283425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034df04-3af9-4ddd-ac18-d67a70cbc556 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.318602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:28.320668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.322129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.322552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.323669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:28.324776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:28.327269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:28.353255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 370/731] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:28.358716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.417341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:28.473129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034df04-3af9-4ddd-ac18-d67a70cbc556 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:28.540928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94515708-1baa-4d7a-8bae-edc2d2e12d72 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:28.552943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:28.553595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.553875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.554145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.577657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:28.579171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:28.581418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:28.583019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.583525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.584065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.592743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:28.594471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:28.598293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:28.599213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:28.600873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:28.600873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:28.600873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:28.600873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 362/732] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:28.600873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.603839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:28.614283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:28.615280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:28.616240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:28.618891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 371/733] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:28.619944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.713608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2079c-3df7-4a91-aefd-010f04f47de8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:28.722162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:28.733562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3af64-112f-4fd1-a968-eaa5371b7fac None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:28.750658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:28.751282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.751601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.751879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.752558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:28.753926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:28.772286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 363/734] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:42:28 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:28.777483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.782601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:28.784229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:28.784829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:28.785245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:28.786233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:28.786723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:28.788266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:28.803726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 372/735] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:28.809815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:28.927244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:28.962675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcd765-13aa-403f-96c4-a92573da4a97 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:29.013091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:29.014119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.014524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.014805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.015607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:29.015923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:29.018041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:29.029414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43484a-00e0-499c-a8f5-49e458996faf None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:29.042499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 364/736] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 24 08:42:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:29.047995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:29.077524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:29.079265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.080484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.080806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.092227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:29.094042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:29.112015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:29.113036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:29.113964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:29.117091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 373/737] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:42:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:29.122459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:29.135635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:29.168971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023cc8-5b78-4971-9fed-d81d4f68d419 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:29.193711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:29.222906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71490beb-0d3b-4ac5-9b86-2d30bc38329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:29.223884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71490beb-0d3b-4ac5-9b86-2d30bc38329b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.225815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71490beb-0d3b-4ac5-9b86-2d30bc38329b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.226297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71490beb-0d3b-4ac5-9b86-2d30bc38329b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.280703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfbad3-c9d5-4115-b111-a4813699286f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:29.319145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b740-0274-41ee-9bed-f44c23d57d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:29.319826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b740-0274-41ee-9bed-f44c23d57d80 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.320076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b740-0274-41ee-9bed-f44c23d57d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.320355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b740-0274-41ee-9bed-f44c23d57d80 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.321127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b740-0274-41ee-9bed-f44c23d57d80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:29.321652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b740-0274-41ee-9bed-f44c23d57d80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:29.322860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0b740-0274-41ee-9bed-f44c23d57d80 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:29.330049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71490beb-0d3b-4ac5-9b86-2d30bc38329b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:29.332067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71490beb-0d3b-4ac5-9b86-2d30bc38329b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:29.341866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 374/738] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 24 08:42:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:29.343342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1017-f6a3-4534-b53f-95185633f4b0 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.343728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1017-f6a3-4534-b53f-95185633f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.344117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1017-f6a3-4534-b53f-95185633f4b0 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.349663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 375/739] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:29.350568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c1017-f6a3-4534-b53f-95185633f4b0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:29.430815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:29.452178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 365/740] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 08:42:29.453775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ae01-b7aa-4696-a2fc-5abebe542f50 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.454167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ae01-b7aa-4696-a2fc-5abebe542f50 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.454584 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4ae01-b7aa-4696-a2fc-5abebe542f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.473194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4cd4ae01-b7aa-4696-a2fc-5abebe542f50 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:29.474525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4cd4ae01-b7aa-4696-a2fc-5abebe542f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:29.476543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c1017-f6a3-4534-b53f-95185633f4b0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:29.492808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:29.516133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e3084-72e8-412c-aab3-2ce672640621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:29.516777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3084-72e8-412c-aab3-2ce672640621 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.517092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3084-72e8-412c-aab3-2ce672640621 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.517369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3084-72e8-412c-aab3-2ce672640621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.551371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 366/741] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:29.552578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4ae01-b7aa-4696-a2fc-5abebe542f50 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:29.592624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e3084-72e8-412c-aab3-2ce672640621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:29.594087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e3084-72e8-412c-aab3-2ce672640621 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:29.658478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:29.698950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 376/742] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 08:42:29.700349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e889c61-d1a1-49ed-80d1-0ea9e6d625e3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.700660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e889c61-d1a1-49ed-80d1-0ea9e6d625e3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.700936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e889c61-d1a1-49ed-80d1-0ea9e6d625e3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.702454 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 377/743] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:29.705210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e889c61-d1a1-49ed-80d1-0ea9e6d625e3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:29.716223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4ae01-b7aa-4696-a2fc-5abebe542f50 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:29.750991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61440881-6cf6-4b41-802a-4d9458df520a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:29.751697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61440881-6cf6-4b41-802a-4d9458df520a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.751975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61440881-6cf6-4b41-802a-4d9458df520a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.752246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61440881-6cf6-4b41-802a-4d9458df520a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.762220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61440881-6cf6-4b41-802a-4d9458df520a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:29.763651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61440881-6cf6-4b41-802a-4d9458df520a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-61440881-6cf6-4b41-802a-4d9458df520a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:29.778307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:29.779262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:29.780152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:29.780152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:29.780152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:29.780152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 367/744] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:29.784956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb319a-20ca-4d2f-a12c-8b74dc806998 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.785245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb319a-20ca-4d2f-a12c-8b74dc806998 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.785696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb319a-20ca-4d2f-a12c-8b74dc806998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.800015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:29.807523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b0eb319a-20ca-4d2f-a12c-8b74dc806998 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:29.808871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b0eb319a-20ca-4d2f-a12c-8b74dc806998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:29.834397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e889c61-d1a1-49ed-80d1-0ea9e6d625e3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:29.877545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:29.878444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:29.878725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:29.878999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:29.882208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 368/745] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 08:42:29.883262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb319a-20ca-4d2f-a12c-8b74dc806998 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:29.890756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:29.893151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:29.912298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:29.913470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:29.914580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:29.914580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:29.914580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:29.914580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 378/746] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:29.920456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:29.948760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:30.006495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb319a-20ca-4d2f-a12c-8b74dc806998 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.034652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e2f4e-924f-4e2c-a8fd-055cf76180d8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.040898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.041574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.041857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.042126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.042766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:30.043067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.044443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.046040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:30.062313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 369/747] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:30.063132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.075138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.076094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.076697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.077184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.078035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:30.078545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.080494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.094062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 379/748] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:30.095461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.166103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae441f-0e49-4c13-ac78-c641d42c9ff2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.182435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:30.203259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.203865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.204141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.204437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.204766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c8b91-c241-4e90-8152-7e3342ccdcfd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.205238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.206596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.222582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 370/749] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:42:30 2022] POST /identity/v3/services => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:30.223478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.253646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.254818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.255332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.255815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.264763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.266678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:30.279904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:30.280917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:30.281811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:30.283563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 380/750] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:30.284670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.294650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:30.358117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf519-996a-48c4-9b01-286906fca47c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.408546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.409185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.409460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.409727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.417842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.418009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.423081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06a667-0851-44e3-af17-f01c7abae642 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:30.436759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:30.437706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:30.438628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 371/751] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:30.439176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.462962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:30.474035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.475002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.475553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.475885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.490844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:30.497868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:30.499015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 381/752] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:30.500878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.560738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15803ad-ced5-4d71-97ed-77246c07086e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.580808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:30.627150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.628011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.628450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.628879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.629717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:30.631207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.633044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.653738 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e099b3-c790-44d5-8cfc-51202eb0d533 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.658605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 372/753] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:30.659682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.719001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.721394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.723852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.724359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.725310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:30.726558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.733299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.754598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 382/754] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:30.756682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.849313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d3b7f-7779-4052-8a85-ef1a46f6e34f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.856005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:30.916950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:30.917959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:30.919220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:30.919886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:30.922965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:30.924036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:30.925696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:30.941320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 373/755] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:30.942147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:30.944552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427afb-e590-461a-acaa-b8a7a6b4803c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:30.981207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:31.048327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:31.049939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.050343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.050755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.051546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=7bb73a7c308340f48fc0106e96de3f7e) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:31.051814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:31.052555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854e60e-ead2-485a-9d04-5bc1e26c2f99 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:31.053358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:31.068887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 383/756] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/role_assignments?user.id=7bb73a7c308340f48fc0106e96de3f7e&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:31.069895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:31.100520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681bdc-77cb-4249-b22d-86d179c8c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:31.101882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681bdc-77cb-4249-b22d-86d179c8c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.102666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681bdc-77cb-4249-b22d-86d179c8c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.103157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681bdc-77cb-4249-b22d-86d179c8c9a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.104331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681bdc-77cb-4249-b22d-86d179c8c9a2 None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=5e4eb89916664004afa763f612d2937b) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:31.104919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681bdc-77cb-4249-b22d-86d179c8c9a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:31.107413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681bdc-77cb-4249-b22d-86d179c8c9a2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:31.132438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 374/757] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:30 2022] GET /identity/v3/role_assignments?user.id=5e4eb89916664004afa763f612d2937b&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:31.136732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3e9e8-ded0-456f-b02c-5ea46919a6c8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.140068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3e9e8-ded0-456f-b02c-5ea46919a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.140638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3e9e8-ded0-456f-b02c-5ea46919a6c8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.143406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 375/758] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:31.152419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18598-c0a2-41d8-ac41-f39920a159d0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.152419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18598-c0a2-41d8-ac41-f39920a159d0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.152419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c18598-c0a2-41d8-ac41-f39920a159d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.190522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-48c18598-c0a2-41d8-ac41-f39920a159d0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:31.191670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-48c18598-c0a2-41d8-ac41-f39920a159d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:31.254595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58101fc6-8b63-43fc-96cd-a4a9074db237 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:31.274208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:31.305240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:31.305905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.306194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.306473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.326087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:31.327577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:31.345798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 376/759] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:31.347421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:31.348344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:31.349542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:31.349542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:31.349542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:31.349542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 384/760] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:31.355114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c18598-c0a2-41d8-ac41-f39920a159d0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:31.385526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:31.462807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c18598-c0a2-41d8-ac41-f39920a159d0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:31.503472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:31.504327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.504787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.505236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.506033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:31.506529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:31.508151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:31.520887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 377/761] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:31.526550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:31.633569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6789d68-391d-42c8-b73c-7ad86e285061 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:31.666877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:31.681476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:31.682128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.682412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.682687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.698455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:31.702775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:31.724346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:31.725330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:31.726272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 385/762] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:42:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:31.734448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:31.775116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:31.832263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:31.856216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd868dac-5bdf-4245-81bd-b450b0e8bf5b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:31.868369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9331c-b8f5-4030-8afa-42318ee8d676 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:31.906378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:31.907018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.907304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.908094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.908734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:31.910597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:31.923123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:31.924220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:31.925098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 378/763] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 24 08:42:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:31.930596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:31.945092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:31.945722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:31.946008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:31.946284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:31.947029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:31.947333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:31.948807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:31.986465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 386/764] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:42:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:32.002382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:32.048460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc9996-947c-4080-a7f5-dc4cd9523552 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.114975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.115593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.115874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.116147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.116810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:32.117115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.118475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.133401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 379/765] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 08:42:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:32.138489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:32.152923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:32.170524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f97f9-4f18-4d84-a925-a36f5b7bfe57 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.185496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:32.222053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.223038 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.223567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.224014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.246919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.248675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:32.268022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:32.269109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:32.269990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:32.269990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:32.269990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:32.276509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 387/766] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:32.277676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ad989-243d-418a-af40-1925381c408f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.278188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:32.313298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.314013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.314302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.314579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.315223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:32.315532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.321226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.323782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 380/767] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 08:42:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:32.328974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:32.394016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db67ec-a2e9-4a6b-9e21-002df6571a07 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.430377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f37baa-bca6-414d-8138-7585d7e489b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.431049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:32.432765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f37baa-bca6-414d-8138-7585d7e489b7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.433130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f37baa-bca6-414d-8138-7585d7e489b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.433463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f37baa-bca6-414d-8138-7585d7e489b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.434284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f37baa-bca6-414d-8138-7585d7e489b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:32.434613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f37baa-bca6-414d-8138-7585d7e489b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.436027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f37baa-bca6-414d-8138-7585d7e489b7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.443799 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:32.450572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 388/768] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:32.451831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee1a6-dea9-4683-a03f-c48f1547186d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.452222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee1a6-dea9-4683-a03f-c48f1547186d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.452627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdee1a6-dea9-4683-a03f-c48f1547186d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.453991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2914585-b3f8-40e7-b536-979f7b94c59b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.454344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 389/769] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:32.455675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee1a6-dea9-4683-a03f-c48f1547186d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:32.493883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841ac62-cd10-49b4-bdda-8d45ce1dbb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.494962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ac62-cd10-49b4-bdda-8d45ce1dbb83 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.495428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ac62-cd10-49b4-bdda-8d45ce1dbb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.495913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841ac62-cd10-49b4-bdda-8d45ce1dbb83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.497058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ac62-cd10-49b4-bdda-8d45ce1dbb83 None admin] RBAC: Adding query filter params (interface=public, service_id=16952dab881c429f8ec0081fb236f170, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:32.497554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ac62-cd10-49b4-bdda-8d45ce1dbb83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.499092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841ac62-cd10-49b4-bdda-8d45ce1dbb83 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.509148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 381/770] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:42:32 2022] GET /identity/v3/endpoints?service_id=16952dab881c429f8ec0081fb236f170&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:32.510657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454d89-dbfb-4919-b5c2-9963c382e660 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.511131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454d89-dbfb-4919-b5c2-9963c382e660 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.511598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454d89-dbfb-4919-b5c2-9963c382e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.537051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e7454d89-dbfb-4919-b5c2-9963c382e660 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:32.538739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e7454d89-dbfb-4919-b5c2-9963c382e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:32.579969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdee1a6-dea9-4683-a03f-c48f1547186d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.625461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.626333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.626715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.627085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.627996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 382/771] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:32.629123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454d89-dbfb-4919-b5c2-9963c382e660 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:32.653146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.654883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:32.678802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:32.679728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:32.680652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:32.685936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 390/772] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:32.691497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:32.715617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:32.741544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454d89-dbfb-4919-b5c2-9963c382e660 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.780813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.781815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.783712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.784212 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.785182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.786773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.793077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 383/773] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:42:32 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:32.843734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:32.911128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c67ea-ac4a-46cf-8995-2b572016aef4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:32.956758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:32.957460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:32.957791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:32.958078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:32.958897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:32.959228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:32.960880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:32.974454 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 391/774] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:32.980182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:33.034927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:33.109179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5636f25-d0a0-4435-ae6d-0d065c183014 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:33.147106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299690fe-09c3-4c13-9f4e-fb86ed824806 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:33.165398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:33.173499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:33.174464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.174988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.175447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/a517cf1b373445fd9e98c4e703732153/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.181812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=a517cf1b373445fd9e98c4e703732153, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:33.183658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:33.202167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:33.206321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d45a6-7389-445f-ae9c-7ef6fe339331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:33.208851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d45a6-7389-445f-ae9c-7ef6fe339331 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.210009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d45a6-7389-445f-ae9c-7ef6fe339331 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.210620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d45a6-7389-445f-ae9c-7ef6fe339331 None admin] PATH_INFO: `/v3/services/network` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.212478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d45a6-7389-445f-ae9c-7ef6fe339331 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:33.214101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d45a6-7389-445f-ae9c-7ef6fe339331 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:33.214550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 384/775] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:32 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/a517cf1b373445fd9e98c4e703732153/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-572d45a6-7389-445f-ae9c-7ef6fe339331 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:33.225461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:33.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:33.227607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:33.230376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 392/776] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:33 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:33.236586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:33.381714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d1da8-2558-44db-8b34-2cb6bdda66f3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:33.391620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702352-c9a0-48dd-9de9-ec5b27a90187 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.391938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702352-c9a0-48dd-9de9-ec5b27a90187 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.392256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce702352-c9a0-48dd-9de9-ec5b27a90187 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.393660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 393/777] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:33.402746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cacbc-ee98-4a51-82b1-3da0375caf24 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.403036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cacbc-ee98-4a51-82b1-3da0375caf24 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.403290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4cacbc-ee98-4a51-82b1-3da0375caf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.433825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6c4cacbc-ee98-4a51-82b1-3da0375caf24 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:33.435111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6c4cacbc-ee98-4a51-82b1-3da0375caf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:33.447722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:33.448355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.448676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.448954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.449605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] RBAC: Adding query filter params (name=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:33.449914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:33.451312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:33.456871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 385/778] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:33.464169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:33.540013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:33.553535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 394/779] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:33.594394 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0fa58-d565-4af0-abf3-c5248eee5551 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:33.627873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7be2-1266-4e84-88b5-f35555329626 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.628544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7be2-1266-4e84-88b5-f35555329626 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.629029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c7be2-1266-4e84-88b5-f35555329626 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.630893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 395/780] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:33.635657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523207-67a9-4940-9d30-05c4016bbf10 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.636176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523207-67a9-4940-9d30-05c4016bbf10 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.636694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54523207-67a9-4940-9d30-05c4016bbf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.647037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:33.647950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.648483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.650098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.650976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] RBAC: Adding query filter params (type=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:33.655258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:33.656978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:33.666363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 386/781] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:33.673668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-54523207-67a9-4940-9d30-05c4016bbf10 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:33.674171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-54523207-67a9-4940-9d30-05c4016bbf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:33.675064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:33.778381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 396/782] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:33.787073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86f56a-a076-4ba9-8e4b-19f45a93c159 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:33.814768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:33.832509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:33.833130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:33.833412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:33.833682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:33.834391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] RBAC: Adding query filter params (interface=public, service_id=966a79e0c8cc4fc3b3a5c58b6cf8ea10, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:33.834701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:33.836064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:33.846251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 387/783] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:42:33 2022] GET /identity/v3/endpoints?service_id=966a79e0c8cc4fc3b3a5c58b6cf8ea10&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:33.847837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523207-67a9-4940-9d30-05c4016bbf10 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:33.908404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:33.913254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:34.006835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54523207-67a9-4940-9d30-05c4016bbf10 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.025637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1ed31-9079-4204-8e01-825e16c87fe4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.056335 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.057051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.057339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.057618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.058243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:34.059644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:34.066187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 397/784] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:42:33 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:34.069710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.070360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.070645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.071129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.083518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:34.088821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:34.089892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:34.090928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:34.091781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.091870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 388/785] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:34.101556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.224800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:34.262480 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dea2bb-ab98-4426-b493-3894751bd5ca None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.272257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:34.288517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2fd5b-35cd-4137-afd7-53da81f37287 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.303784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.304528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.304874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.305794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.319703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:34.325856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:34.326777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:34.327891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 398/786] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:34.331497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.332417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.332890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.333365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.333470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.334334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:34.334819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:34.336360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:34.347637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 389/787] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:34.353060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.458340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba70fda-43ec-4a2f-8a76-2c11d0bd375e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.479786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:34.502073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527583-f949-477e-b40c-db4e2439676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.502706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527583-f949-477e-b40c-db4e2439676b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.502982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527583-f949-477e-b40c-db4e2439676b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.503251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11527583-f949-477e-b40c-db4e2439676b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.514881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527583-f949-477e-b40c-db4e2439676b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:34.516339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11527583-f949-477e-b40c-db4e2439676b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-11527583-f949-477e-b40c-db4e2439676b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:34.530970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:34.531933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:34.533324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:34.533324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:34.533324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:34.533324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 390/788] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:34.537927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527583-f949-477e-b40c-db4e2439676b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.594513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1340ff-18f5-4afb-a1be-43b8d1ce9c8a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.657391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11527583-f949-477e-b40c-db4e2439676b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.668591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.669216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.669492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.669765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.670446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:34.670759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:34.672203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:34.690437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 399/789] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:34.695987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.725420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.726047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.726331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.726609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.727265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:34.727574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:34.728983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:34.753612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:34.753823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 391/790] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:34.761399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.818643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c370b03-898a-4850-af94-d93f9ba21a70 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:34.820293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:34.854339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:34.854976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:34.855350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:34.855628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:34.866932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:34.868432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:34.894692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:34.895680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:34.896601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:34.896601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:34.896601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:34.896601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 400/791] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:34.902780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:34.935262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d098575-9e98-419b-bda2-51443c8aec57 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:35.008903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:35.009460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.009743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.010019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.023088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:35.024587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:35.053704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:35.056302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:35.058539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 392/792] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:35.066178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:35.072572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:35.105363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bca8c-2eed-4955-ad11-920132611c89 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:35.156690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015fc7a-7de1-49c1-ae37-2a30cc3ccdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:35.157406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015fc7a-7de1-49c1-ae37-2a30cc3ccdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.157759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015fc7a-7de1-49c1-ae37-2a30cc3ccdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.158036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015fc7a-7de1-49c1-ae37-2a30cc3ccdb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.158684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015fc7a-7de1-49c1-ae37-2a30cc3ccdb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:35.158989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015fc7a-7de1-49c1-ae37-2a30cc3ccdb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:35.160500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015fc7a-7de1-49c1-ae37-2a30cc3ccdb0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:35.174475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 401/793] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:35.175832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347423b0-7636-4d03-85d0-fc55e4912a8d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.176118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347423b0-7636-4d03-85d0-fc55e4912a8d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.176463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347423b0-7636-4d03-85d0-fc55e4912a8d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.181873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 402/794] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:35.182710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347423b0-7636-4d03-85d0-fc55e4912a8d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:35.198262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:35.220560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3fed3-ee6b-4000-b438-b3dfcacf469d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:35.264525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c863193-882a-4911-892c-c7810433d8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:35.265070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c863193-882a-4911-892c-c7810433d8dc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.265349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c863193-882a-4911-892c-c7810433d8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.265621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c863193-882a-4911-892c-c7810433d8dc None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.266620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c863193-882a-4911-892c-c7810433d8dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:35.268037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c863193-882a-4911-892c-c7810433d8dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:35.269816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c863193-882a-4911-892c-c7810433d8dc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:35.292440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 393/795] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 24 08:42:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:35.294499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a5e0-ebd3-462e-8fc8-4d323e77f0c9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.294844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a5e0-ebd3-462e-8fc8-4d323e77f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.295288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826a5e0-ebd3-462e-8fc8-4d323e77f0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.309548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347423b0-7636-4d03-85d0-fc55e4912a8d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:35.321432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1826a5e0-ebd3-462e-8fc8-4d323e77f0c9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:35.323452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1826a5e0-ebd3-462e-8fc8-4d323e77f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:35.347115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:35.347815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.348101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.348375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.357274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:35.358793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:35.362773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:35.376673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:35.377740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:35.378901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:35.381255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 403/796] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:42:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:35.382321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:35.416485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 394/797] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:35.417782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a5e0-ebd3-462e-8fc8-4d323e77f0c9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:35.592944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:35.625918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826a5e0-ebd3-462e-8fc8-4d323e77f0c9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:35.667838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55c9cf-8f16-4288-8166-0be469309f01 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:35.704404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3fca9-4f53-4162-b6ae-c236df3adc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:35.705668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3fca9-4f53-4162-b6ae-c236df3adc09 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.705946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3fca9-4f53-4162-b6ae-c236df3adc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.706217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3fca9-4f53-4162-b6ae-c236df3adc09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.717470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3fca9-4f53-4162-b6ae-c236df3adc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:35.719020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3fca9-4f53-4162-b6ae-c236df3adc09 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-3da3fca9-4f53-4162-b6ae-c236df3adc09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:35.734630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:35.735754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:35.736710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:35.736710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:35.736710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:35.740824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 404/798] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:35.742434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da851987-75e1-4ef1-8f03-14c1faf0b366 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.742727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da851987-75e1-4ef1-8f03-14c1faf0b366 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.742995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da851987-75e1-4ef1-8f03-14c1faf0b366 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.748737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 405/799] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:35.749673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da851987-75e1-4ef1-8f03-14c1faf0b366 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:35.800631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee1b78-db9d-4106-8086-4856c194ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:35.801250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee1b78-db9d-4106-8086-4856c194ea4e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.801538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee1b78-db9d-4106-8086-4856c194ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.801816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee1b78-db9d-4106-8086-4856c194ea4e None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.802554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee1b78-db9d-4106-8086-4856c194ea4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:35.802863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee1b78-db9d-4106-8086-4856c194ea4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:35.804307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee1b78-db9d-4106-8086-4856c194ea4e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:35.808202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:35.829334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 395/800] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 24 08:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:35.829334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f477c7-af76-4e1a-a237-05bfaedfa229 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.829334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f477c7-af76-4e1a-a237-05bfaedfa229 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.829334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f477c7-af76-4e1a-a237-05bfaedfa229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.846607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-00f477c7-af76-4e1a-a237-05bfaedfa229 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:35.848192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-00f477c7-af76-4e1a-a237-05bfaedfa229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:35.880839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da851987-75e1-4ef1-8f03-14c1faf0b366 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:35.928417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 396/801] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:35.928417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f477c7-af76-4e1a-a237-05bfaedfa229 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:35.930554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:35.931190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:35.931467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:35.931743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:35.932414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:35.932734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:35.934114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:35.961455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 406/802] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:35.962497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.018426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.073071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f477c7-af76-4e1a-a237-05bfaedfa229 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.090879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129c941-e180-4400-bc52-1912dacce321 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.106757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.112802 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.113813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.114355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.114831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.115635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.117256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:36.126525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:36.127528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 08:42:36.128373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:36.129149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 397/803] 10.222.0.42 () {56 vars in 1129 bytes} [Wed Aug 24 08:42:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:36.134840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.135478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.136119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.136416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.136689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.155714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.158329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:36.178254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:36.179262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:36.180256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:36.180256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:36.180256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:36.188072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 407/804] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:36.188072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.271560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3fc29-bc65-4c92-bf75-af12f808a513 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.298965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.307273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36dc4-b054-4f95-a9e6-12af89d51c80 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.310195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.310831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.311114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.311392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.318206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.319638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:36.331073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:36.331996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:36.332914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 398/805] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:36.333838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.348592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.349137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.349420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.349693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.350321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:36.350630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.351996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.356312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 408/806] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:36.357818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.388713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.443479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243f775-17e8-484d-b892-f4f1b95eabec None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.461184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a861e4-c631-4698-81b4-20fdb76544ce None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.479448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.480103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.480402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.480688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.481669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:36.481669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.482962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.494022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 399/807] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:36.494956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.497351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec6789-b86b-4839-9333-896886be712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.497981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6789-b86b-4839-9333-896886be712a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.498379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6789-b86b-4839-9333-896886be712a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.498731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6789-b86b-4839-9333-896886be712a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.509351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec6789-b86b-4839-9333-896886be712a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f8ec6789-b86b-4839-9333-896886be712a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:36.514648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:36.515737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:36.516872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 409/808] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:36.518288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fffd5-ec20-43e6-93a3-1d36b3f816a1 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.518288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fffd5-ec20-43e6-93a3-1d36b3f816a1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.518288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fffd5-ec20-43e6-93a3-1d36b3f816a1 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.519436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 410/809] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:36.520124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fffd5-ec20-43e6-93a3-1d36b3f816a1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.547874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.603565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554a89-900c-440a-b478-db9c06d231fc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.616037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.629679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fffd5-ec20-43e6-93a3-1d36b3f816a1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.637957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.638563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.638844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.639379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.640071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:36.640405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.641833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.653399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 400/810] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:36.654196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.665097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.665777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.666124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.666469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.667206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:36.667561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.669181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.674580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 411/811] 10.222.0.42 () {56 vars in 1124 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:36.675404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.753179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba6107-f930-47c0-99f6-1dfbfcfe3df7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.760329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.776595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc377a8f-2150-49a5-99bc-d31b085170aa None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.789609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a48f22-3cb8-449e-8ece-e106cd476769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.790238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a48f22-3cb8-449e-8ece-e106cd476769 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.790521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a48f22-3cb8-449e-8ece-e106cd476769 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.790794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a48f22-3cb8-449e-8ece-e106cd476769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.797364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a48f22-3cb8-449e-8ece-e106cd476769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.799566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a48f22-3cb8-449e-8ece-e106cd476769 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-56a48f22-3cb8-449e-8ece-e106cd476769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:36.810415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:36.811453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:36.812352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:36.812941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.813033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 401/812] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:36.813103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.813103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.813103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.813292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea252-0791-401d-85df-aa80926a24f7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.813292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea252-0791-401d-85df-aa80926a24f7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.813474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:36.813563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea252-0791-401d-85df-aa80926a24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.813802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.815173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.824039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 412/813] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:36.824929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.831798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8c8ea252-0791-401d-85df-aa80926a24f7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:36.833024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8c8ea252-0791-401d-85df-aa80926a24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:36.844213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:36.903117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 402/814] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:36.904298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea252-0791-401d-85df-aa80926a24f7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:36.927815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbdff6-157a-4489-adf0-96dcb183d110 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:36.963094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:36.963964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:36.964408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:36.964827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/7bb73a7c308340f48fc0106e96de3f7e/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:36.966958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=7bb73a7c308340f48fc0106e96de3f7e, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:36.968552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:36.982914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 413/815] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:36 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/7bb73a7c308340f48fc0106e96de3f7e/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:42:36.983925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.046023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea252-0791-401d-85df-aa80926a24f7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.049265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:37.078840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:37.099478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.100289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.100724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.101095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.102183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.104500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.113678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e19350-bd2c-43f6-8881-43d8ba1f7d0f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.137730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 403/816] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:42:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:37.138795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.172411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.173402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.174105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.174528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.176215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:37.176792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.179253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.195925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 414/817] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:37.196841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.273850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823c8e-e505-4281-b81d-65be7e6fbb33 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.323087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.324071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.324363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.324763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.336166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.337689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:37.352991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:37.354172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:37.355266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:37.355266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:37.355266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:37.355266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 404/818] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:37.361392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.361545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145bcb2-91a5-4e94-925e-acdc342ff2d4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.361653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:37.400346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:37.406865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.408274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.408745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.409315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] PATH_INFO: `/v3/services/network` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.409814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.411352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:37.423063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:37.424259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 08:42:37.425423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:37.427775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 415/819] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:37 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:37.429038 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.476016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32364b5-33ca-446d-9392-52ea417aea50 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.512305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.513302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.514119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.514405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/5e4eb89916664004afa763f612d2937b/roles/d255dac55c5e4f468635e33a1d42d34a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.531737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=5e4eb89916664004afa763f612d2937b, role_id=d255dac55c5e4f468635e33a1d42d34a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.533938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.553227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 405/820] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:37 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/5e4eb89916664004afa763f612d2937b/roles/d255dac55c5e4f468635e33a1d42d34a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:42:37.554458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.562793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1960c06-eada-4067-b106-7ee5eabd4453 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.654181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.654877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.655159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.655441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.656211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:37.656544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.658106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.687670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 416/821] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:37.691981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:37.693034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.757221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c97ef-35cd-4416-9323-9636e9633628 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.779967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:37.795067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.795943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.796376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.796822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.797605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:37.798135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.799636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.804834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 406/822] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:37.809975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.832503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1b75f-4802-41dd-b301-e14a3e8a9e7d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:37.886221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:37.886867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:37.887151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:37.887419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:37.899121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:37.901353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:37.925372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:37.926597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:42:37.927766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:37.930176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 417/823] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:42:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:37.934439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:37.975430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717a03-64c8-405d-b12d-e2bfc9c633e3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:38.026712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:38.046621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa42c1-9707-469e-96e2-e6b2829d2e38 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:38.072657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:38.085426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:38.085718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:38.086009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:38.086374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:38.087211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:38.087522 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:38.089096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:38.093387 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:38.093659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:38.093940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:38.094213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:38.094853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] RBAC: Adding query filter params (type=network) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:38.095521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:38.096914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:38.107873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 407/824] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:38.114028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:38.120471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 418/825] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:42:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:38.125732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:38.287631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451427b-7d6e-41ab-b06c-9a290e88dff9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:38.305120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac8e54-2234-4c93-81ed-b39bd453cffd None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:38.349602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:38.350418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:38.350808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:38.351191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:38.351969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:38.353979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:38.365209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:38.365996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:38.366408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:38.366785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:38.383646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 408/826] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:42:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:38.452813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:38.490476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:38.492129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:38.616178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 419/827] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:42:38.621882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:38.676988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:38.756872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2b0b6-cc19-4727-aada-04cf8d596704 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:38.797870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:38.798539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:38.798821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:38.799097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:38.810980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:38.812513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:38.828046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:38.829092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:38.831589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:38.831589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:38.831589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:38.831589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 409/828] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:38.837549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:38.921472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:38.952368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c03c8-0462-426e-b025-feb445680dcc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:38.990162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651a0b4-7fb4-4f99-b0b9-77ad0ad060bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:38.990770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a0b4-7fb4-4f99-b0b9-77ad0ad060bf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:38.991044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a0b4-7fb4-4f99-b0b9-77ad0ad060bf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:38.991312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651a0b4-7fb4-4f99-b0b9-77ad0ad060bf None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:38.991950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651a0b4-7fb4-4f99-b0b9-77ad0ad060bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:38.992246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651a0b4-7fb4-4f99-b0b9-77ad0ad060bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:38.993646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651a0b4-7fb4-4f99-b0b9-77ad0ad060bf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:39.005927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 420/829] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:39.011199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:39.099397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:39.114703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55def-b23f-48f5-b57c-b4cbfc219581 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:39.148800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:39.149429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.149718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.149965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.154849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239b8a5-266c-4d20-95ba-ccdc429d0cfd None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.154849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239b8a5-266c-4d20-95ba-ccdc429d0cfd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.154849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239b8a5-266c-4d20-95ba-ccdc429d0cfd None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.156951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:39.157196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 421/830] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:39.160414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:39.164421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759604cb-a851-4c18-9228-23f03377de3f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.164421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759604cb-a851-4c18-9228-23f03377de3f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.164421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759604cb-a851-4c18-9228-23f03377de3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:39.170133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:39.171012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:39.172186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 410/831] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:39.176886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:39.187810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-759604cb-a851-4c18-9228-23f03377de3f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:39.189807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-759604cb-a851-4c18-9228-23f03377de3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:39.272482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 422/832] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:39.291149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df381c-cc0e-4b9c-83bd-c27bedb58c8b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:39.338676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b9a80-3d84-4fa0-b2eb-9ac02877b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:39.339604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9a80-3d84-4fa0-b2eb-9ac02877b25b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.340067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9a80-3d84-4fa0-b2eb-9ac02877b25b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.340574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b9a80-3d84-4fa0-b2eb-9ac02877b25b None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.341476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9a80-3d84-4fa0-b2eb-9ac02877b25b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:39.341961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9a80-3d84-4fa0-b2eb-9ac02877b25b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:39.343624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b9a80-3d84-4fa0-b2eb-9ac02877b25b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:39.356950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 411/833] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:39.363183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759604cb-a851-4c18-9228-23f03377de3f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:39.398528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2877b43-a830-4171-acdc-645f829080a7 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.399097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2877b43-a830-4171-acdc-645f829080a7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.399546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2877b43-a830-4171-acdc-645f829080a7 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.411792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 412/834] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:39.417927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111b01f-ba99-4732-9b10-e694be039fb2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.418507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111b01f-ba99-4732-9b10-e694be039fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.418986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111b01f-ba99-4732-9b10-e694be039fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.432757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:39.439947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d111b01f-ba99-4732-9b10-e694be039fb2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:39.441488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d111b01f-ba99-4732-9b10-e694be039fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:39.442023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:39.491533 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759604cb-a851-4c18-9228-23f03377de3f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:39.524806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 413/835] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:39.532045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:39.533221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.533503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.533774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.534542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=a517cf1b373445fd9e98c4e703732153) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:39.534804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:39.536249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:39.542224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 423/836] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:39 2022] GET /identity/v3/role_assignments?user.id=a517cf1b373445fd9e98c4e703732153&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:39.550356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111b01f-ba99-4732-9b10-e694be039fb2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:39.670376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111b01f-ba99-4732-9b10-e694be039fb2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:39.709825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d5ae1-8a8a-4436-8e9c-7e959ee35b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:39.710494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d5ae1-8a8a-4436-8e9c-7e959ee35b5e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.710735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d5ae1-8a8a-4436-8e9c-7e959ee35b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.711005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d5ae1-8a8a-4436-8e9c-7e959ee35b5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.714056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:39.723295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d5ae1-8a8a-4436-8e9c-7e959ee35b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-7a8d5ae1-8a8a-4436-8e9c-7e959ee35b5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:39.728073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:39.729036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:39.730374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 414/837] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:39.737964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:39.811949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b277d4-f59b-4c8d-aa3c-dbad56136434 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.812242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b277d4-f59b-4c8d-aa3c-dbad56136434 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.812572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b277d4-f59b-4c8d-aa3c-dbad56136434 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.814112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 415/838] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:39.819876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66541-ddd8-4a2d-b8e8-09e09facf4c4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.820282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66541-ddd8-4a2d-b8e8-09e09facf4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.820592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b66541-ddd8-4a2d-b8e8-09e09facf4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.843251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742af6a-a15c-4cda-87dc-05cb208f4aec None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:39.844148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-45b66541-ddd8-4a2d-b8e8-09e09facf4c4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:39.847084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-45b66541-ddd8-4a2d-b8e8-09e09facf4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:39.871951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:39.880826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:39.881433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:39.881714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:39.881983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:39.882653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:39.882953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:39.884326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:39.894536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 424/839] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:39.895351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:39.918878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 416/840] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:39.919936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66541-ddd8-4a2d-b8e8-09e09facf4c4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.027557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b66541-ddd8-4a2d-b8e8-09e09facf4c4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.035105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb841e7-0e03-4697-b3e3-bbda11fcd93f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.055419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.065189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.065825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.066102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.066377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.076983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.078367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.084938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.086301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.086847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.087816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.088919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.090507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:40.093808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:40.094732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:40.096341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:40.096341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:40.096341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:40.096341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 417/841] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:40.101252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:40.104483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:40.105518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:40.106346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:40.109622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 425/842] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:40.116106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.171149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.224634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d4d7c-c6eb-4637-9a2e-aa85fab62a97 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.228258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775b075-ad53-42e6-bfea-70b3ef07ca54 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.257520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.258130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.258410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.258684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.259315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:40.259613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.261016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.264941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.265652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 426/843] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:40.265652 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.270817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.271135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.271421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.272156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:40.272490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.273856 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.288617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 418/844] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:40.289416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.331553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.371292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87364-ca8e-47cc-b9b6-605d84997085 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.388713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.393807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48218c-916a-461f-af1b-fb35d23168b7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.407246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.407968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.408168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.408468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.419268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:40.424921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:40.425836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:40.426675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 427/845] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:40.427361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.434737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.435349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.435627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.435897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.436898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:40.436898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.438207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.443153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 419/846] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:40.443789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.561995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166e21d-8e2c-4d2f-bc21-e0069980e90a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.564189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.576295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e243b2-9a81-4e18-bb77-bd5f2a78f171 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.622784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fb938-0991-4136-8891-869101e68909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.623705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb938-0991-4136-8891-869101e68909 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.624159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb938-0991-4136-8891-869101e68909 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.624636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fb938-0991-4136-8891-869101e68909 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.625515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fb938-0991-4136-8891-869101e68909 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:40.625903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.626361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fb938-0991-4136-8891-869101e68909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.626731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.627083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.627424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.628492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fb938-0991-4136-8891-869101e68909 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.637088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.638671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.639125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 420/847] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:40.644625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fb938-0991-4136-8891-869101e68909 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:40.652528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:40.653530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 08:42:40.654477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:40.659057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 428/848] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:40.660015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.702822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.777797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08992b09-8aa9-4600-a176-42aec7e16e46 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.791406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fb938-0991-4136-8891-869101e68909 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:40.815012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.815684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.815879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.816092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.816857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:40.817162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.818601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.837034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23299210-a50d-44cf-baba-3691948da044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:40.837757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 429/849] 10.222.0.42 () {56 vars in 1135 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:40.838164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23299210-a50d-44cf-baba-3691948da044 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:40.838443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23299210-a50d-44cf-baba-3691948da044 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:40.838710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23299210-a50d-44cf-baba-3691948da044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:40.842904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.851117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23299210-a50d-44cf-baba-3691948da044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:40.852620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23299210-a50d-44cf-baba-3691948da044 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-23299210-a50d-44cf-baba-3691948da044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:40.871429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:40.872685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:40.873624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:40.873624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:40.873624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:40.873624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 421/850] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:40.880373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23299210-a50d-44cf-baba-3691948da044 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:40.900881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.967454 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:40.974676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0205c18-c7bd-4cd3-b5ac-ab625555005e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.007411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23299210-a50d-44cf-baba-3691948da044 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.023222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.024316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.024743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.025121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.045072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.045966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.046395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.046811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.047596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:41.048100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.049670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.067091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 422/851] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:41.068560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.101362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.103173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.149112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:41.174546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be16d0-0abf-44b5-be90-f6d73ace92a5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.207101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:41.210598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.211537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.212098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.212621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.216796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 430/852] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:42:41.220468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.222013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.222192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:41.233998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:41.236114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:41.237112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:41.243874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 423/853] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:41.244956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.354002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6aa05-f4ea-4724-a777-7b719368bf87 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.365957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4592fb-1f12-4bc9-b2e2-3a22ad5caf8e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.390992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.391907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.392370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.392842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.393792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:41.394279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.395969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.398760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:41.404256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.405628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.406050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.406476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.417809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.419482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.420544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 424/854] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:41.422565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:41.436918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:41.437914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:41.439376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:41.439376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:41.439376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:41.441948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 431/855] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:41.451939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.512306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:41.528717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b4e85-71ec-4281-954b-d113cff181e7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.563011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2f688-006c-40c0-8275-4a232c640c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.564307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2f688-006c-40c0-8275-4a232c640c2c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.564710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2f688-006c-40c0-8275-4a232c640c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.565057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2f688-006c-40c0-8275-4a232c640c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.588855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3940cff-b5f8-45b4-a943-c07fd7352e5f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.625026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aafc3a-cb53-4d2c-8233-9ffd8b78c895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.625591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aafc3a-cb53-4d2c-8233-9ffd8b78c895 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.625874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aafc3a-cb53-4d2c-8233-9ffd8b78c895 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.626692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aafc3a-cb53-4d2c-8233-9ffd8b78c895 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.627333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aafc3a-cb53-4d2c-8233-9ffd8b78c895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:41.627638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aafc3a-cb53-4d2c-8233-9ffd8b78c895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.629052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aafc3a-cb53-4d2c-8233-9ffd8b78c895 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.630469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:41.640865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2f688-006c-40c0-8275-4a232c640c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.646307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 432/856] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:41.646307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15ac5-cc77-497f-a529-c3ef0d8213fa None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.646528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2f688-006c-40c0-8275-4a232c640c2c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.646642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15ac5-cc77-497f-a529-c3ef0d8213fa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.646642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf15ac5-cc77-497f-a529-c3ef0d8213fa None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.646642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 433/857] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:41.647872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15ac5-cc77-497f-a529-c3ef0d8213fa None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.753615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf15ac5-cc77-497f-a529-c3ef0d8213fa None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.761407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 425/858] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 08:42:41.762201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:41.762818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6730b9-3b1b-4535-9cff-be64fe656c4b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.763176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6730b9-3b1b-4535-9cff-be64fe656c4b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.763461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6730b9-3b1b-4535-9cff-be64fe656c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.782781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5e6730b9-3b1b-4535-9cff-be64fe656c4b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:41.783906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5e6730b9-3b1b-4535-9cff-be64fe656c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:41.796686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:41.797313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:41.797590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:41.797881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:41.805091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:41.806420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:41.818925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:41.819839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 434/859] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:41.825840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.859828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 426/860] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:41.860183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6730b9-3b1b-4535-9cff-be64fe656c4b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:41.885797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:41.961374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c747913-4c88-4d5c-ab19-80e1c6ab8d37 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:41.979867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6730b9-3b1b-4535-9cff-be64fe656c4b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.004690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.005383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.005860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.006235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.020143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.021651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.028769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.029636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.030575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.031180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.032177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:42.032733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.034321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:42.036642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:42.037580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:42.038488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:42.038488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:42.038488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:42.042591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 435/861] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:42.043596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.061642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 427/862] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:42.062397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.070865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:42.161634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:42.164720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56301d3-56e9-4799-96b4-b8f8399d5948 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.180595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04e129-a365-423d-95a5-35d6dd3fafa9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.199238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.199852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.200135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.200433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.201087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:42.201392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.202768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.215022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 436/863] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:42.215871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.220420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.220888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.221086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.221354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.222090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=7bb73a7c308340f48fc0106e96de3f7e) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:42.222399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.223822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.229977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 428/864] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/role_assignments?user.id=7bb73a7c308340f48fc0106e96de3f7e&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:42.230623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.330476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:42.357690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf11597-ca47-4b73-866a-3d888a13a9a8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.359596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6a92-6c4b-4a8d-8a7a-51d0e4904970 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.401535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd9b14-4c49-4805-a2c7-308221d377f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.401859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b042d4-2aeb-4365-a52e-d1392c7a04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.402178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9b14-4c49-4805-a2c7-308221d377f4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.402416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b042d4-2aeb-4365-a52e-d1392c7a04d4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.402519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9b14-4c49-4805-a2c7-308221d377f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.402696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b042d4-2aeb-4365-a52e-d1392c7a04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.402803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd9b14-4c49-4805-a2c7-308221d377f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.402989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b042d4-2aeb-4365-a52e-d1392c7a04d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.403550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b042d4-2aeb-4365-a52e-d1392c7a04d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.405252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b042d4-2aeb-4365-a52e-d1392c7a04d4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.410855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9b14-4c49-4805-a2c7-308221d377f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.412271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd9b14-4c49-4805-a2c7-308221d377f4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-88b042d4-2aeb-4365-a52e-d1392c7a04d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:42.414976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:42.415881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:42.416875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:42.420496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 437/865] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:42.421752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7067a5b-9329-4cad-8bef-e894b8c31c57 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.422034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7067a5b-9329-4cad-8bef-e894b8c31c57 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.422314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7067a5b-9329-4cad-8bef-e894b8c31c57 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-18fd9b14-4c49-4805-a2c7-308221d377f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:42.424167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:42.425883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:42.427948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:42.428872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 438/866] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:42.429016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 429/867] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:42.429154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7067a5b-9329-4cad-8bef-e894b8c31c57 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.432026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251459c7-ce2b-408c-b411-7744ed6eb170 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.432026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251459c7-ce2b-408c-b411-7744ed6eb170 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.432361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251459c7-ce2b-408c-b411-7744ed6eb170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.450606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-251459c7-ce2b-408c-b411-7744ed6eb170 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:42.451793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-251459c7-ce2b-408c-b411-7744ed6eb170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:42.453842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:42.523506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 430/868] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:42.533640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251459c7-ce2b-408c-b411-7744ed6eb170 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.546858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7067a5b-9329-4cad-8bef-e894b8c31c57 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.597011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.598103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.598607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.599084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.600019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:42.600665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.602290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.612769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 439/869] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:42.614292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.624172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:42.643146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251459c7-ce2b-408c-b411-7744ed6eb170 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.682972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.682972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.683251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.683504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.684238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:42.684578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.686301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.693881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:42.700417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 431/870] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:42.707672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.743665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24887d0a-ba58-4150-860e-aae60f8e13bb None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.790313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.790933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.791216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.791493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.792586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:42.792903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.795118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.800615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 440/871] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:42.801399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:42.840361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba3ea6-48fd-4cc2-ada1-619207cfbe94 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.880617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:42.893170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d3d94-dd9b-4806-8dea-1632b00caabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.894442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3d94-dd9b-4806-8dea-1632b00caabc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.894924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3d94-dd9b-4806-8dea-1632b00caabc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.895764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d3d94-dd9b-4806-8dea-1632b00caabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.897313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d3d94-dd9b-4806-8dea-1632b00caabc None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=5e4eb89916664004afa763f612d2937b) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:42.898130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d3d94-dd9b-4806-8dea-1632b00caabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.900502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d3d94-dd9b-4806-8dea-1632b00caabc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.909496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 432/872] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:42 2022] GET /identity/v3/role_assignments?user.id=5e4eb89916664004afa763f612d2937b&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:42.917491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae90c29-1d3d-4bc1-abdb-a15d345d1cb3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:42.962495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fca8c-473d-4c08-9bdb-9fd0c0a5f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:42.963049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fca8c-473d-4c08-9bdb-9fd0c0a5f9dd None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:42.963332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fca8c-473d-4c08-9bdb-9fd0c0a5f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:42.963607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fca8c-473d-4c08-9bdb-9fd0c0a5f9dd None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:42.964272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fca8c-473d-4c08-9bdb-9fd0c0a5f9dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:42.965740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fca8c-473d-4c08-9bdb-9fd0c0a5f9dd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:42.986961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 441/873] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:42:42 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:44.231464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6cc8-d502-4419-8919-78c266aae0f8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.232544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6cc8-d502-4419-8919-78c266aae0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.233029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6cc8-d502-4419-8919-78c266aae0f8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.234785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 433/874] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:44.240808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415adfba-223b-4ed0-8434-6d8cd961f7da None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.241583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415adfba-223b-4ed0-8434-6d8cd961f7da None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.242074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415adfba-223b-4ed0-8434-6d8cd961f7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.260943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-415adfba-223b-4ed0-8434-6d8cd961f7da None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:44.262400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-415adfba-223b-4ed0-8434-6d8cd961f7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:44.336067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 442/875] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:44.608144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6cc8-d502-4419-8919-78c266aae0f8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:44.674848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:44.717301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6cc8-d502-4419-8919-78c266aae0f8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:44.753000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92334d2f-b336-4471-8c35-9f9be5369d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:44.753975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92334d2f-b336-4471-8c35-9f9be5369d3d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.754451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92334d2f-b336-4471-8c35-9f9be5369d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.754957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92334d2f-b336-4471-8c35-9f9be5369d3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.755750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92334d2f-b336-4471-8c35-9f9be5369d3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:44.757315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92334d2f-b336-4471-8c35-9f9be5369d3d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-92334d2f-b336-4471-8c35-9f9be5369d3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:44.767167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:44.768153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:44.769247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:44.771972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 434/876] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:44.778379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415adfba-223b-4ed0-8434-6d8cd961f7da None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:44.792464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8dc69-6582-458e-a95f-56f9e9181123 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.793092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8dc69-6582-458e-a95f-56f9e9181123 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.793594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8dc69-6582-458e-a95f-56f9e9181123 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.796007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 435/877] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:44.801213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9d3f-f684-4f2c-8f40-b016ff66a9b3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.801493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9d3f-f684-4f2c-8f40-b016ff66a9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.801765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9d3f-f684-4f2c-8f40-b016ff66a9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.821034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a03f9d3f-f684-4f2c-8f40-b016ff66a9b3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:44.822535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a03f9d3f-f684-4f2c-8f40-b016ff66a9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:44.855316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:44.904563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 436/878] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:44.909020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415adfba-223b-4ed0-8434-6d8cd961f7da None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:44.939288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef7bd6-aa11-4021-9864-23b6a667901b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.939994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef7bd6-aa11-4021-9864-23b6a667901b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.940543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef7bd6-aa11-4021-9864-23b6a667901b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.942443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 437/879] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:44.944944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:44.945736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.946144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.946541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.947030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce916-9b76-4f8c-8073-af42537c91ef None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:44.947318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce916-9b76-4f8c-8073-af42537c91ef None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:44.947590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bce916-9b76-4f8c-8073-af42537c91ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:44.947718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:44.948128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:44.949650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:44.955083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 443/880] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:44.961168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:44.969438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c4bce916-9b76-4f8c-8073-af42537c91ef None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:44.971178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c4bce916-9b76-4f8c-8073-af42537c91ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:45.035016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:45.053914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 438/881] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:45.055855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535595c-5c57-4832-b69b-bcb34a7c66b7 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.056694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535595c-5c57-4832-b69b-bcb34a7c66b7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.057169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535595c-5c57-4832-b69b-bcb34a7c66b7 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.059431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 439/882] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:45.065238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810752-94eb-4a6a-b309-b0cf8e748c1e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.065733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810752-94eb-4a6a-b309-b0cf8e748c1e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.066523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3810752-94eb-4a6a-b309-b0cf8e748c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.071789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86408c-5967-465f-b543-42bb34955dd6 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.088149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f3810752-94eb-4a6a-b309-b0cf8e748c1e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:45.089651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f3810752-94eb-4a6a-b309-b0cf8e748c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:45.103283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:45.113333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.113503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.113711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.113987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.114981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:45.115447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:45.117234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:45.124429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 444/883] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:45.177280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.179296 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 440/884] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:45.293611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f6300-ba94-4153-958c-68b93f5cc449 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.330485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.331095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.331372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.331643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.332297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:45.333705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:45.336170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810752-94eb-4a6a-b309-b0cf8e748c1e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.354210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 445/885] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:42:45 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:42:45.466067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3810752-94eb-4a6a-b309-b0cf8e748c1e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.468256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.488800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:45.519182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.519825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.520153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.520418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.533069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:45.538241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:45.539166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:42:45.540007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:45.540685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:45.540758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 441/886] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 24 08:42:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:45.547125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.611230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ac15-743b-42ee-a677-6c21669977a1 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.656732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.657556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.657838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.658374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.659382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:45.661276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:45.666575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d19227-5b77-416a-9063-d1999c3029f8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:45.672657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:45.674361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:45.675361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 446/887] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:45.683253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.716400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.717000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.717279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.717553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.718284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:45.718588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:45.720089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:45.729367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 442/888] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 24 08:42:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:45.734447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.774318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:45.801568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b11dc-a48c-41d9-b4d1-e7711c5e3180 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.811082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:45.838597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.839221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.839506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.839782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.840439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:45.840766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:45.842138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:45.851786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 447/889] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:45.853125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.853423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453ea26-47df-49f4-9c4a-49ce43680abf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.893783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.894816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.895412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.895906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.908119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:45.910001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:45.926211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:45.927209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:45.928127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:45.928127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:45.928127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:45.930239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 443/890] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:45.940445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:45.957832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bdad5-dc4b-4ebe-a4c5-4c4cff948b13 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:45.993483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:45.994016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:45.994305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:45.994579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:45.995207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:45.995511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:45.996919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:46.007166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 448/891] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:46.008558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:46.034504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:46.046979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:46.055668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdfd96-0811-44c1-9bbc-42fd343f246f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:46.093946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:46.095473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:46.095986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:46.096450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:46.097340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:46.097788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:46.099406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:46.117461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3ef4-aa4e-48f9-a881-7c74654e69be None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:46.117748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 444/892] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:46.118739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:46.150509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:46.151132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:46.151423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:46.151688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:46.152411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] RBAC: Adding query filter params (interface=public, service_id=eb4eb0f2753041268171926a7e49f0f3, region_id=RegionOne) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:46.152728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:46.154260 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:46.166876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 449/893] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:42:46 2022] GET /identity/v3/endpoints?service_id=eb4eb0f2753041268171926a7e49f0f3&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:46.168340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:46.228347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fd69b-69ed-44f1-9f51-94dcd347e6ad None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:46.269669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:46.270860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:46.271746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:46.272363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:46.274960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:46.279556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e1814-034a-4ddd-ac49-df54707c19e9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:46.290452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:46.292891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:46.309992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:46.311170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:46.312324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:46.320083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 445/894] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:42:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:46.321403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:46.327251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:46.327924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:46.328204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:46.328503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:46.329227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:46.330617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:46.333948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:46.338463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 450/895] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:42:46 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:42:46.442838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8097e6-0610-489b-bd0e-a731aa56a234 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:46.480710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:46.481610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:46.482049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:46.482323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:46.483060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:46.483368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:46.484842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:46.505930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 446/896] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 24 08:42:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:46.511860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:46.624657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afcfcc-0368-45fd-92eb-b0f88113336b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:46.661328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:46.662267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:46.662898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:46.663356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:46.696591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:46.735925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:46.737713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:46.846494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 451/897] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:46 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:42:46.852340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:46.926396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:46.967896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e5058-be67-48e0-ae87-9b9b51cb34c8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:47.005157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b35d17-efb3-4508-96ce-ae9d4eb65130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:47.005808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b35d17-efb3-4508-96ce-ae9d4eb65130 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.006090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b35d17-efb3-4508-96ce-ae9d4eb65130 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.006370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b35d17-efb3-4508-96ce-ae9d4eb65130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.021547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b35d17-efb3-4508-96ce-ae9d4eb65130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:47.023011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b35d17-efb3-4508-96ce-ae9d4eb65130 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-18b35d17-efb3-4508-96ce-ae9d4eb65130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:47.038295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:47.039310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:47.040221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:47.040221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:47.040221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:47.040221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 447/898] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:47.046726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:47.116500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:47.153956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f97c-5a02-48cc-944d-0e90010dce51 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.154285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f97c-5a02-48cc-944d-0e90010dce51 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.154513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02f97c-5a02-48cc-944d-0e90010dce51 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.155171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab92a-57ad-4345-ab80-99f19cfa0ae0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:47.155973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 448/899] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:47.162356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff6725-f63b-4c6a-a6d7-cf9cb79c308a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.162880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff6725-f63b-4c6a-a6d7-cf9cb79c308a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.163753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff6725-f63b-4c6a-a6d7-cf9cb79c308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.186591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0bff6725-f63b-4c6a-a6d7-cf9cb79c308a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:47.188851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0bff6725-f63b-4c6a-a6d7-cf9cb79c308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:47.191987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:47.192643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.192930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.193208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.193854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:47.194162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:47.195544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:47.209150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 452/900] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:47.217711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:47.280432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 449/901] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:47.335665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34402af-8d80-43a8-8d02-039d10f204da None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:47.359111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:47.361754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a35f9-a664-49e0-a1ee-15552739eb16 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.362149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a35f9-a664-49e0-a1ee-15552739eb16 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.362425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a35f9-a664-49e0-a1ee-15552739eb16 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.364901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 450/902] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:47.372042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27428-2fd7-4b53-b55d-67fdc129f82b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.372370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27428-2fd7-4b53-b55d-67fdc129f82b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.372691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27428-2fd7-4b53-b55d-67fdc129f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.374230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:47.374867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.375148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.375420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.385597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:47.387072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:47.393788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-05d27428-2fd7-4b53-b55d-67fdc129f82b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:47.394969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-05d27428-2fd7-4b53-b55d-67fdc129f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:47.401359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:47.402254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:47.403130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:47.403566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 453/903] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:47.408805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:47.439788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:47.465046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 451/904] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:47.519107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e913-8650-4c04-8b4d-bb0afac4ca0f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:47.560306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:47.561268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.561796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.562270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.563170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:47.564205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:47.565962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:47.582062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27428-2fd7-4b53-b55d-67fdc129f82b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:47.591647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 454/905] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:47.600283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:47.648245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:47.680874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27428-2fd7-4b53-b55d-67fdc129f82b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:47.706289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29374392-5ac5-4e23-a9f6-9f1068469fa5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:47.715065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:47.715588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.715868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.716142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.716818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:47.718166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:47.739267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 452/906] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:42:47 2022] POST /identity/v3/services => generated 241 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:47.740406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:47.755537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:47.756584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.757066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.757605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.758574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] RBAC: Adding query filter params (role.id=9bb76ebe298e4c0b811f1a1114f53a3a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=5e4eb89916664004afa763f612d2937b) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:47.759047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:47.760978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:47.774152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 455/907] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:47 2022] GET /identity/v3/role_assignments?user.id=5e4eb89916664004afa763f612d2937b&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=9bb76ebe298e4c0b811f1a1114f53a3a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:47.786623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:47.866576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7110-d6ef-4cb9-b6e5-b17e6eb3bee6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:47.906320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:47.906893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:47.907244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:47.907616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:47.908241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:47.909677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:47.919200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:47.920433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:47.921679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 453/908] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 24 08:42:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:47.929352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:48.040161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7474b6-5351-48fb-97cc-9f5669d9323a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:48.042648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:48.075546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:48.076249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:48.076629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:48.076967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:48.077664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:48.078033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:48.079994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:48.085295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 456/909] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:48.092669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:48.197069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:48.200289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccd608-a2e0-4516-869b-3da06075d151 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:48.237960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d208635-da93-4409-bb64-4e4ec1d85090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:48.238583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208635-da93-4409-bb64-4e4ec1d85090 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:48.238868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208635-da93-4409-bb64-4e4ec1d85090 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:48.239148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208635-da93-4409-bb64-4e4ec1d85090 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:48.239779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d208635-da93-4409-bb64-4e4ec1d85090 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:48.240084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d208635-da93-4409-bb64-4e4ec1d85090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:48.241483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d208635-da93-4409-bb64-4e4ec1d85090 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:48.246901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 454/910] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:48.253568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:48.355676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fd303-45b2-4225-915d-52b58b48f0ee None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:48.377760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bcc86-cc5b-4135-8ebb-7211f5fc3917 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:48.378025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bcc86-cc5b-4135-8ebb-7211f5fc3917 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:48.378313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bcc86-cc5b-4135-8ebb-7211f5fc3917 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:48.379749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 455/911] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:48.385729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d522b-f5c2-4b57-9288-d9b50d1cca24 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:48.386020 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d522b-f5c2-4b57-9288-d9b50d1cca24 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:48.386299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d522b-f5c2-4b57-9288-d9b50d1cca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:48.392065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:48.392905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:48.393337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:48.393770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:48.394477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] RBAC: Adding query filter params (interface=public, service_id=955d7561acd246bfa43c66b101511370, region_id=RegionOne) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:48.394792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:48.396156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:48.401626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 457/912] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:42:48 2022] GET /identity/v3/endpoints?service_id=955d7561acd246bfa43c66b101511370&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:48.405582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-377d522b-f5c2-4b57-9288-d9b50d1cca24 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:48.406873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:48.407788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-377d522b-f5c2-4b57-9288-d9b50d1cca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:48.443698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:48.499310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 456/913] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:48.534214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4c9bb-8eed-4612-b5bb-f84f3dfaf2f2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:48.569056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:48.569655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:48.569928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:48.570198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:48.570803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:48.572216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:48.592130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 458/914] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:42:48 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:42:48.797284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d522b-f5c2-4b57-9288-d9b50d1cca24 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:48.893856 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:48.902094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d522b-f5c2-4b57-9288-d9b50d1cca24 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:48.937806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:48.938971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:48.939249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:48.939519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:48.940111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:48.941489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:48.950182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:48.951171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:48.952012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 457/915] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:48.957418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:49.062023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:49.070248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d91495-edf8-4e5e-98c0-2a7165785131 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:49.105521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:49.106466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:49.106943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:49.107436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:49.108274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:49.108796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:49.110563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:49.115853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 459/916] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:49.121663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:49.225695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c921294-06dc-4180-bf53-ba6616e548ca None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:49.260195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40a2fb-83b2-4d0f-9365-6e20bd97aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:49.261163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a2fb-83b2-4d0f-9365-6e20bd97aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:49.261661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a2fb-83b2-4d0f-9365-6e20bd97aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:49.262153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40a2fb-83b2-4d0f-9365-6e20bd97aaf7 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:49.262974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a2fb-83b2-4d0f-9365-6e20bd97aaf7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:49.263481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a2fb-83b2-4d0f-9365-6e20bd97aaf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:49.265309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40a2fb-83b2-4d0f-9365-6e20bd97aaf7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:49.270827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 458/917] 10.222.0.42 () {56 vars in 1114 bytes} [Wed Aug 24 08:42:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:49.276667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:49.382198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c92b7-a56f-4517-857e-872865a3d0e7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:49.416638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf963e83-66be-4630-964d-8c966f6cd787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:49.417296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963e83-66be-4630-964d-8c966f6cd787 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:49.417582 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963e83-66be-4630-964d-8c966f6cd787 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:49.417856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf963e83-66be-4630-964d-8c966f6cd787 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:49.418531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf963e83-66be-4630-964d-8c966f6cd787 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:49.419910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf963e83-66be-4630-964d-8c966f6cd787 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:49.444175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 460/918] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:42:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:49.743754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee43e-e8d9-4d0c-a921-feaa691c09aa None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:49.744301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee43e-e8d9-4d0c-a921-feaa691c09aa None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:49.744301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ee43e-e8d9-4d0c-a921-feaa691c09aa None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:49.746189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 459/919] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:49.751627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e769071-c17a-4988-b314-161172682d82 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:49.751922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e769071-c17a-4988-b314-161172682d82 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:49.752206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e769071-c17a-4988-b314-161172682d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:49.772438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3e769071-c17a-4988-b314-161172682d82 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:49.773637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3e769071-c17a-4988-b314-161172682d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:49.785995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:49.850166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 461/920] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:49.913938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef133d2-aabc-4766-9885-76d6544f38a5 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:49.914587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef133d2-aabc-4766-9885-76d6544f38a5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:49.915058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef133d2-aabc-4766-9885-76d6544f38a5 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:49.916877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 460/921] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:49.922379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc168-ac78-41a0-bc4e-7ee18bd5c9af None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:49.922769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc168-ac78-41a0-bc4e-7ee18bd5c9af None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:49.923014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc168-ac78-41a0-bc4e-7ee18bd5c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:49.941903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9d9cc168-ac78-41a0-bc4e-7ee18bd5c9af None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:49.943095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9d9cc168-ac78-41a0-bc4e-7ee18bd5c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:50.012991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 462/922] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:50.122263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef133d2-aabc-4766-9885-76d6544f38a5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.147905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:50.230867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef133d2-aabc-4766-9885-76d6544f38a5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:50.265090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:50.265919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.266863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.267292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.278238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:50.283292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:50.284422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:42:50.285453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:50.287682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 461/923] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:50.293511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc168-ac78-41a0-bc4e-7ee18bd5c9af None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.298404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.376225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:50.387479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:50.415553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc168-ac78-41a0-bc4e-7ee18bd5c9af None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:50.419448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e135b7e-d0ea-440a-a693-580f6da15b46 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:50.452318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:50.453169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.453283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.453511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.454216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:50.454524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:50.455892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:50.464979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 463/924] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:50.471405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:50.471900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.472288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.472690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.473055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.473742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:50.475209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:50.485248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:50.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:50.487511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:50.494658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 462/925] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:50.495333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.604768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee67e35-ecce-4486-8ec7-b248efdbb477 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:50.607679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7631ef-9c93-4abc-bf26-2efe02f7266a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:50.640957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe838f5-217f-433a-827c-be6da5c6a908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:50.641619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe838f5-217f-433a-827c-be6da5c6a908 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.641903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe838f5-217f-433a-827c-be6da5c6a908 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.642178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe838f5-217f-433a-827c-be6da5c6a908 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.642811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe838f5-217f-433a-827c-be6da5c6a908 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:50.642978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201a790-778e-445f-b6e5-dc49cd0a5301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:50.643111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe838f5-217f-433a-827c-be6da5c6a908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:50.643589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201a790-778e-445f-b6e5-dc49cd0a5301 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.643866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201a790-778e-445f-b6e5-dc49cd0a5301 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.644136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201a790-778e-445f-b6e5-dc49cd0a5301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.644489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe838f5-217f-433a-827c-be6da5c6a908 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:50.646487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:50.653885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 463/926] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:50.653885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511b48-a0b6-4006-a4d9-73f5b3855df1 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.653885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511b48-a0b6-4006-a4d9-73f5b3855df1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.653885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0511b48-a0b6-4006-a4d9-73f5b3855df1 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.656308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 464/927] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:50.657660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511b48-a0b6-4006-a4d9-73f5b3855df1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.659853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201a790-778e-445f-b6e5-dc49cd0a5301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:50.662441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201a790-778e-445f-b6e5-dc49cd0a5301 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:50.669374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-3201a790-778e-445f-b6e5-dc49cd0a5301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:50.678939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:50.679892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:50.680841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:50.680841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:50.680841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:50.680841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 464/928] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:50.681940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa4710-c0ae-4e3c-8f33-570d4796ac53 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.681940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa4710-c0ae-4e3c-8f33-570d4796ac53 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.681940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa4710-c0ae-4e3c-8f33-570d4796ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.700222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-29aa4710-c0ae-4e3c-8f33-570d4796ac53 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:50.701699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-29aa4710-c0ae-4e3c-8f33-570d4796ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:50.766729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0511b48-a0b6-4006-a4d9-73f5b3855df1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:50.773332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 465/929] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:50.773973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa4710-c0ae-4e3c-8f33-570d4796ac53 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.825245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:50.826581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.827073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.827549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.828517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:50.830162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:50.832315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:50.844900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 465/930] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:50.847122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.881678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa4710-c0ae-4e3c-8f33-570d4796ac53 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:50.900595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:50.919724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:50.920353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:50.920663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:50.920898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:50.921540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:50.921836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:50.923831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:50.937565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 466/931] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:50.942687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:50.963250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:50.999352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e84dde-2d8a-48b5-8abe-75892ce36800 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.050142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.050762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.051047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.051323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.052034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] RBAC: Adding query filter params (interface=public, service_id=129dbdf914ed4e109d0ca7cdc0065ecd, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:51.052346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.053684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fdec6-26f6-4a32-9e36-2eeab11cc1ea None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.053789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.059472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 466/932] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/endpoints?service_id=129dbdf914ed4e109d0ca7cdc0065ecd&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:51.064037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.093062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.093620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.093900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.094171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.102432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.103936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:51.117547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:51.118562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:51.119498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:51.123393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 467/933] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:42:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:51.124226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.166128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:51.172490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46805390-b395-4c9d-85da-a4e1999b8fcc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.208361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21228583-d825-4448-8c49-749724d3f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.209011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21228583-d825-4448-8c49-749724d3f09a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.209290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21228583-d825-4448-8c49-749724d3f09a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.209560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21228583-d825-4448-8c49-749724d3f09a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.210147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21228583-d825-4448-8c49-749724d3f09a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.211494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21228583-d825-4448-8c49-749724d3f09a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-21228583-d825-4448-8c49-749724d3f09a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:51.220661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:51.221623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:51.222516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 467/934] 10.222.0.42 () {56 vars in 1132 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:51.223313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21228583-d825-4448-8c49-749724d3f09a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.225088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:51.245872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f2fa2-0093-46d1-a0b2-944e76434589 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.283375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.284009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.284273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.284577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.285190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.286573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.292886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 468/935] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:42:51.293600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.349825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21228583-d825-4448-8c49-749724d3f09a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.395327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59baa-b16b-44db-9f94-d468c0c9f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.396642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59baa-b16b-44db-9f94-d468c0c9f6ea None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.397669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59baa-b16b-44db-9f94-d468c0c9f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.398161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59baa-b16b-44db-9f94-d468c0c9f6ea None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.399384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59baa-b16b-44db-9f94-d468c0c9f6ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:51.400152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59baa-b16b-44db-9f94-d468c0c9f6ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.402267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59baa-b16b-44db-9f94-d468c0c9f6ea None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.415872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:51.419537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526cc76-decc-45c5-a52d-196eb47ee58e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.431668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 468/936] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:51.433520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1db8c-8d34-4f58-8df3-770bce588e54 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.433964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1db8c-8d34-4f58-8df3-770bce588e54 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.434414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1db8c-8d34-4f58-8df3-770bce588e54 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.436677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 469/937] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:51.437854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1db8c-8d34-4f58-8df3-770bce588e54 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.458880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27135a7-4e11-4700-a3cd-5524ba337a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.459495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27135a7-4e11-4700-a3cd-5524ba337a9c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.459772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27135a7-4e11-4700-a3cd-5524ba337a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.460041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27135a7-4e11-4700-a3cd-5524ba337a9c None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.460973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27135a7-4e11-4700-a3cd-5524ba337a9c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:51.461275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27135a7-4e11-4700-a3cd-5524ba337a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.462653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27135a7-4e11-4700-a3cd-5524ba337a9c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.468593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 469/938] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:51.470140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01d7e-9acd-4920-8f0c-113b8bf1e8e2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.470517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01d7e-9acd-4920-8f0c-113b8bf1e8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.470748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc01d7e-9acd-4920-8f0c-113b8bf1e8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.490046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dbc01d7e-9acd-4920-8f0c-113b8bf1e8e2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:51.491233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dbc01d7e-9acd-4920-8f0c-113b8bf1e8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:51.517191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:51.562897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1db8c-8d34-4f58-8df3-770bce588e54 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.566217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 470/939] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:51.567101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01d7e-9acd-4920-8f0c-113b8bf1e8e2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.614929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.615925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.616533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.617003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.628560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.630333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:51.646795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:51.647749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:51.648693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:51.648693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:51.648693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:51.655498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 470/940] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:51.656765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.683222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:51.693748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc01d7e-9acd-4920-8f0c-113b8bf1e8e2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.739757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.740407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.740693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.740968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.741609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:51.741915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.743404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.750021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 471/941] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:51.755352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.776930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1eea3-3428-40cf-9548-3b7414ba300f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.811389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:51.816523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.817731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.818267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.818718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.819548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:51.820031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.821725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.840464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 471/942] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:51.842092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.879180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a5a6-8497-4f97-9923-126a4eb4f03e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:51.914489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:51.915101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:51.915384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:51.915657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:51.916329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:51.917741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:51.939667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 472/943] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:42:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:42:51.940793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:51.959995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:51.982060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67ea5-c57c-4210-845f-33a99ba07fe8 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:52.031565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:52.032655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:52.033167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:52.033639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:52.041789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:52.043641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:52.057596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:52.058571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:52.059445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:52.067300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 472/944] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:52.068656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:52.093641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b649b-0b82-4cfa-a673-d746bc050792 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:52.103500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:52.137545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:52.138084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:52.138362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:52.138631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:52.139529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:52.141006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:52.143776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING keystone.server.flask.common [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 08:42:52.164961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.sql.core [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 08:42:52.164961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 08:42:52.164961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [parameters: {'id': 'd3c52cad53e3463cbce557cec786306d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 08:42:52.164961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81542) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3c52cad53e3463cbce557cec786306d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3c52cad53e3463cbce557cec786306d. Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 08:42:52.173242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 08:42:52.174280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application yield resource Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise self.value Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application session.commit() Aug 24 08:42:52.175425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.flush() Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application compat.raise_( Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 08:42:52.176330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 08:42:52.177333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 08:42:52.178278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [parameters: {'id': 'd3c52cad53e3463cbce557cec786306d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:52.179394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:52.180245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3c52cad53e3463cbce557cec786306d. Aug 24 08:42:52.181208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.183469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 473/945] 10.222.0.42 () {60 vars in 1140 bytes} [Wed Aug 24 08:42:51 2022] POST /identity/v3/projects => generated 262 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:52.192451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:52.203995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434dfaf-231c-4622-8e41-a94e70cc84f9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:52.240892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:52.241504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:52.241792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:52.242067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:52.242896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:52.243589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:52.244763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:52.258651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 473/946] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:52.264325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:52.281326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:52.317859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2cb0b-b77d-4bd8-ae9d-23316ee5f0fa None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:52.354912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:52.355658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:52.356037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:52.356528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:52.364839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:52.366778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:52.379424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:52.380786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:52.382020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:52.382995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:52.388653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 474/947] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:52.390813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:52.394210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5066e1d-45bf-41f7-b173-eb3f7db08b0e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:52.450448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b1d99-d957-4d36-983b-6df2dc8a9748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:52.451116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b1d99-d957-4d36-983b-6df2dc8a9748 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:52.451396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b1d99-d957-4d36-983b-6df2dc8a9748 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:52.451674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b1d99-d957-4d36-983b-6df2dc8a9748 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/5e4eb89916664004afa763f612d2937b/roles/9bb76ebe298e4c0b811f1a1114f53a3a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:52.455289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b1d99-d957-4d36-983b-6df2dc8a9748 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=5e4eb89916664004afa763f612d2937b, role_id=9bb76ebe298e4c0b811f1a1114f53a3a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:52.456911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b1d99-d957-4d36-983b-6df2dc8a9748 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:52.474219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 474/948] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:42:52 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/5e4eb89916664004afa763f612d2937b/roles/9bb76ebe298e4c0b811f1a1114f53a3a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:42:52.523329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f90748-e0ba-4440-bc88-e1c1e06292e7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:52.557944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:52.565997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99e9ce-b114-49d7-85f9-dff0364f9b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:52.567042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99e9ce-b114-49d7-85f9-dff0364f9b7c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:52.567503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99e9ce-b114-49d7-85f9-dff0364f9b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:52.567963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99e9ce-b114-49d7-85f9-dff0364f9b7c None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:52.568880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99e9ce-b114-49d7-85f9-dff0364f9b7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:52.569386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99e9ce-b114-49d7-85f9-dff0364f9b7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:52.571029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99e9ce-b114-49d7-85f9-dff0364f9b7c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:52.594700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 475/949] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:53.242587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa970489-8dc0-4053-af07-292f7053bcbb None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:53.243149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa970489-8dc0-4053-af07-292f7053bcbb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:53.243149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa970489-8dc0-4053-af07-292f7053bcbb None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:53.244844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 475/950] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:53.250155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8332-6d3f-4d33-8951-d4f3b555cc33 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:53.250448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8332-6d3f-4d33-8951-d4f3b555cc33 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:53.250794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8332-6d3f-4d33-8951-d4f3b555cc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:53.270529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ac5a8332-6d3f-4d33-8951-d4f3b555cc33 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:53.272103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ac5a8332-6d3f-4d33-8951-d4f3b555cc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:53.348501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 476/951] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:53.614301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa970489-8dc0-4053-af07-292f7053bcbb None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:53.721323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa970489-8dc0-4053-af07-292f7053bcbb None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:53.758691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:53.759325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:53.759610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:53.759883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:53.760502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:53.761971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:53.771362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:53.772436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:53.773364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:53.776621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 476/952] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:53.778915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a8332-6d3f-4d33-8951-d4f3b555cc33 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:53.888064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a8332-6d3f-4d33-8951-d4f3b555cc33 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:53.910117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:53.927006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58da1f5-3221-4b47-9666-8f854eaec866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:53.927943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58da1f5-3221-4b47-9666-8f854eaec866 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:53.928482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58da1f5-3221-4b47-9666-8f854eaec866 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:53.928972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58da1f5-3221-4b47-9666-8f854eaec866 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:53.929987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58da1f5-3221-4b47-9666-8f854eaec866 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:53.930502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58da1f5-3221-4b47-9666-8f854eaec866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:53.932079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58da1f5-3221-4b47-9666-8f854eaec866 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:53.937315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 477/953] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:53.943326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:53.960834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:53.995239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7436ec-a3d2-4376-a533-496d9b723741 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:53.995880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7436ec-a3d2-4376-a533-496d9b723741 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:53.996424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7436ec-a3d2-4376-a533-496d9b723741 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:53.998264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 478/954] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:54.003563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde767e-5c1e-4ca9-97dc-9916f4aecb37 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.004112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde767e-5c1e-4ca9-97dc-9916f4aecb37 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.004633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde767e-5c1e-4ca9-97dc-9916f4aecb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.023909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-afde767e-5c1e-4ca9-97dc-9916f4aecb37 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:54.025483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-afde767e-5c1e-4ca9-97dc-9916f4aecb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:54.050800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4a9f9-01d3-4420-a1cb-db6b8a786c27 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:54.086579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:54.087200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.087481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.087762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.088683 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:54.088995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:54.090514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:54.108514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 477/956] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:54.108514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:54.108814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 479/956] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:54.189772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:54.213492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7211e2a-81da-4f8e-ba6c-27ed5c10dd5d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:54.248355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e188697-c2f1-40fe-a0c7-b41196cc624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:54.249046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188697-c2f1-40fe-a0c7-b41196cc624f None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.249265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188697-c2f1-40fe-a0c7-b41196cc624f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.249547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e188697-c2f1-40fe-a0c7-b41196cc624f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.250217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e188697-c2f1-40fe-a0c7-b41196cc624f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:54.252114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e188697-c2f1-40fe-a0c7-b41196cc624f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:54.278719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 478/957] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:42:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:42:54.376495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde767e-5c1e-4ca9-97dc-9916f4aecb37 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:54.400944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0127-4a37-4b31-a9e1-c67bb1a98c05 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.401262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0127-4a37-4b31-a9e1-c67bb1a98c05 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.401483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0127-4a37-4b31-a9e1-c67bb1a98c05 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.403091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 479/958] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:54.409124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadd44-88ce-4217-89d6-4b95cbb0e5a0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.409412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadd44-88ce-4217-89d6-4b95cbb0e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.409677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adadd44-88ce-4217-89d6-4b95cbb0e5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.429142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6adadd44-88ce-4217-89d6-4b95cbb0e5a0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:54.430619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6adadd44-88ce-4217-89d6-4b95cbb0e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:54.492496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde767e-5c1e-4ca9-97dc-9916f4aecb37 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:54.510284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:54.528935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 480/959] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:54.535529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4f213-d695-4392-881f-3a43f609e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:54.536180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4f213-d695-4392-881f-3a43f609e23c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.536516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4f213-d695-4392-881f-3a43f609e23c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.536798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4f213-d695-4392-881f-3a43f609e23c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.537391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4f213-d695-4392-881f-3a43f609e23c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:54.538781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4f213-d695-4392-881f-3a43f609e23c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a5f4f213-d695-4392-881f-3a43f609e23c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:54.548693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:54.549803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:54.550713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 480/960] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:54.555950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adadd44-88ce-4217-89d6-4b95cbb0e5a0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:54.605921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99855a60-b3b1-4d42-ad9b-9b84fe7d06e1 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.606284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99855a60-b3b1-4d42-ad9b-9b84fe7d06e1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.606632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99855a60-b3b1-4d42-ad9b-9b84fe7d06e1 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.608300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 481/961] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:54.613400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f78f7-9389-427e-9887-cb2e805838e0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.613757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f78f7-9389-427e-9887-cb2e805838e0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.614100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f78f7-9389-427e-9887-cb2e805838e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.631882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-576f78f7-9389-427e-9887-cb2e805838e0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:54.633212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-576f78f7-9389-427e-9887-cb2e805838e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:54.637547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:54.688117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adadd44-88ce-4217-89d6-4b95cbb0e5a0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:54.708745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 482/962] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:54.726446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:54.727190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.727561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.727929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.728749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:54.729172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:54.730618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:54.736534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 481/963] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:54.741965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f78f7-9389-427e-9887-cb2e805838e0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:54.814213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:54.848623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f78f7-9389-427e-9887-cb2e805838e0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:54.858257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:54.884782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:54.885413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.885680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.885954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.886589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:54.886893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:54.888339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:54.894736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 483/964] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:42:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:54.928545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdfbdc-49bd-4f40-8778-3380eb7644fe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:54.955202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:54.969158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:54.970590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:54.971015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:54.971460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:54.983487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:42:54.989351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:54.990506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:42:54.991543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:54.993106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:54.994047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 482/965] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 24 08:42:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:55.000028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.107873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5137ca5-0392-4a18-b778-f985f6d3f73b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.130474 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da3ef7-02f7-459f-ad01-1118905a9128 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.149389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.150280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.150562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.150839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.151739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.153605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.170366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.171098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.171385 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.171720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.172532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:55.172864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.173369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.sql.core [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 08:42:55.173369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 08:42:55.173369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [parameters: {'user_id': 'af6ccc154a21461d9019232ea2c3207f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 08:42:55.173369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81542) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 08:42:55.174277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 24 08:42:55.183182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 08:42:55.184158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application yield resource Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application next(self.gen) Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise self.value Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application session.commit() Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 08:42:55.185193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.session.flush() Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application compat.raise_( Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 08:42:55.186796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 08:42:55.188000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application conn.query(q) Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application result.read() Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 08:42:55.191026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [parameters: {'user_id': 'af6ccc154a21461d9019232ea2c3207f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:55.195023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 08:42:55.196931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 484/966] 10.222.0.42 () {60 vars in 1131 bytes} [Wed Aug 24 08:42:54 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:55.199609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.203532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 483/967] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 24 08:42:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:55.203532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.251711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:55.252452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:55.327997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58428b77-7cb9-4218-ae55-e04a8fa70c05 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.335802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20864124-e605-4aee-ab7f-1fd2ea325e89 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.371886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.372970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.373465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.373908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.379070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.379823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.380207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.380609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.386034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.387639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.390218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.392906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:55.403234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:55.404541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:55.405462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:55.405462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:55.405462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:55.407084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:55.408023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:55.409046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 485/968] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:42:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:55.410523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 484/969] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:55.415448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.416554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.530489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:55.531294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fccc88-215e-4293-9036-0a25d55784c1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.539201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d1f1-d8e5-46a1-a3a4-d6d9cc92468a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.540910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:55.587909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.588553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.588841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.589118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.589769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:55.590067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.591262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.591427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.592161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.592612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.593045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.593884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:55.594474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.596889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.603890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 485/970] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:55.610654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.638543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 486/971] 10.222.0.42 () {56 vars in 1101 bytes} [Wed Aug 24 08:42:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:55.727986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177fae-0336-4edd-ac7c-3dd766bdd01e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.767462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.768115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.768410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.768723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.776845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.778298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:42:55.791242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:55.792485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 08:42:55.793443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:55.794008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 486/972] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:42:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:55.799092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.910052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f6946-c65e-4a2a-80f4-eabb6ea6e217 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:55.943767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:55.944400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:55.944691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:55.944965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:55.945700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:55.946005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:55.947435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:55.964684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 487/973] 10.222.0.42 () {56 vars in 1149 bytes} [Wed Aug 24 08:42:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:55.970759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:55.990093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:56.073459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481090d5-7490-4887-91c2-9f213d743e8a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:56.112171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fdae1-7f2c-46be-be55-19809b7871f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:56.112810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fdae1-7f2c-46be-be55-19809b7871f1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.113094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fdae1-7f2c-46be-be55-19809b7871f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.113483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fdae1-7f2c-46be-be55-19809b7871f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.182125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fdae1-7f2c-46be-be55-19809b7871f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:56.183562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fdae1-7f2c-46be-be55-19809b7871f1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:56.200097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:56.288529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 487/974] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:42:55 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:42:56.289752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:56.293258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0bd4-eef5-43fc-80b7-a091223c0e24 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.293557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0bd4-eef5-43fc-80b7-a091223c0e24 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.293843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c0bd4-eef5-43fc-80b7-a091223c0e24 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.295354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 488/975] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:42:56.300855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff901a-4be4-4a9c-a22c-8db29dca34c0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.301153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff901a-4be4-4a9c-a22c-8db29dca34c0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.301429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff901a-4be4-4a9c-a22c-8db29dca34c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.302592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:56.321494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5eff901a-4be4-4a9c-a22c-8db29dca34c0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:56.323175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5eff901a-4be4-4a9c-a22c-8db29dca34c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:56.398906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 489/976] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:56.404665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58bd68-1f09-4741-afad-9944ff539f28 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:56.440456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:56.441022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.441301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.441573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.451656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:56.453144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:42:56.467620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:56.468560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:42:56.469982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:42:56.469982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:42:56.469982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:56.472712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 488/977] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:56.474784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff901a-4be4-4a9c-a22c-8db29dca34c0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:56.521579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:56.579198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff901a-4be4-4a9c-a22c-8db29dca34c0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:56.618638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:56.619252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.619538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.619816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.620494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:56.620804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:56.622172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:56.637971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 490/978] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:56.639390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:56.668061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:56.706429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:56.747760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d0201-5fde-4708-8ba8-d024f8ba7605 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:56.777552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13158fe-2074-457c-8437-c375e0c8c194 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:56.785617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:56.786617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.786748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:56.787635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.788162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.800955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:56.802573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:42:56.813899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:56.814853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:42:56.815839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 489/979] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:56.818785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:56.819419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.819831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.820678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.821552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:56.822676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:56.822676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:56.834956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:56.835989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:56.837880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 491/980] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:42:56.842333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:56.928767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93291b46-9d54-419e-a876-dfe62fd7eee8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:56.941263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf0fc9-5f2e-4a27-b500-f6ad13941687 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:56.951092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:56.963345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1fcab-228b-4bb3-be23-bc1c9b8d3c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:56.963901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fcab-228b-4bb3-be23-bc1c9b8d3c30 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.964185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fcab-228b-4bb3-be23-bc1c9b8d3c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.964489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fcab-228b-4bb3-be23-bc1c9b8d3c30 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.965181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1fcab-228b-4bb3-be23-bc1c9b8d3c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:56.965489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1fcab-228b-4bb3-be23-bc1c9b8d3c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:56.966925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1fcab-228b-4bb3-be23-bc1c9b8d3c30 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:56.975711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:56.976420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.976714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.976987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.977620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:56.977927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:56.979264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:56.979688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 490/981] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:56.981073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3135-30e9-4854-90be-92b6969a01e3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.981349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3135-30e9-4854-90be-92b6969a01e3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.981630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f3135-30e9-4854-90be-92b6969a01e3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.982980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 491/982] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:56.984198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 492/983] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:56.988627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93769a9f-7dbb-43fc-b788-c128c908a917 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:56.988870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93769a9f-7dbb-43fc-b788-c128c908a917 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:56.989148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93769a9f-7dbb-43fc-b788-c128c908a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:56.989569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:57.006446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-93769a9f-7dbb-43fc-b788-c128c908a917 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:57.007970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-93769a9f-7dbb-43fc-b788-c128c908a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:57.023218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:57.073173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 492/984] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:57.073984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93769a9f-7dbb-43fc-b788-c128c908a917 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:57.089211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6f9b7-d9f8-4644-a5f0-3d1c60ef1303 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:57.128217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:57.128862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:57.129144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:57.129420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:57.130273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] RBAC: Adding query filter params (role.id=9bb76ebe298e4c0b811f1a1114f53a3a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=5e4eb89916664004afa763f612d2937b) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:57.130694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:57.132113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:57.138459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 493/985] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:42:56 2022] GET /identity/v3/role_assignments?user.id=5e4eb89916664004afa763f612d2937b&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=9bb76ebe298e4c0b811f1a1114f53a3a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:57.180669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93769a9f-7dbb-43fc-b788-c128c908a917 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:57.196981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:57.221435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:57.221980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:57.222263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:57.222539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:57.223192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:57.223499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:57.224948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:57.235730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 493/986] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:42:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:57.237166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:57.339915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:57.343669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0245dd1-bc89-4bb5-b818-c62f6dd66d87 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:57.346712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:57.382793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:57.383405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:57.383690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:57.383965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:57.384722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] RBAC: Adding query filter params (interface=admin, service_id=129dbdf914ed4e109d0ca7cdc0065ecd, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:57.385039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:57.386398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:57.392112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 494/987] 10.222.0.42 () {56 vars in 1249 bytes} [Wed Aug 24 08:42:57 2022] GET /identity/v3/endpoints?service_id=129dbdf914ed4e109d0ca7cdc0065ecd&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:57.397538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:57.457385 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f6c4f-67aa-4b41-ab2c-afebc3ef5bc0 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:57.497544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dacbf0-5f8a-414e-b8f7-9d85e2cc3786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:57.498132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dacbf0-5f8a-414e-b8f7-9d85e2cc3786 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:57.498353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dacbf0-5f8a-414e-b8f7-9d85e2cc3786 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:57.498700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dacbf0-5f8a-414e-b8f7-9d85e2cc3786 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:57.499277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dacbf0-5f8a-414e-b8f7-9d85e2cc3786 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:57.501212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dacbf0-5f8a-414e-b8f7-9d85e2cc3786 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:57.501580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320825-7292-439f-a992-a211982eaf35 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:57.520431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 494/988] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:42:57 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:42:57.552349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab150ef-d46e-4662-8c8d-01c46c366c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:57.553329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab150ef-d46e-4662-8c8d-01c46c366c0c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:57.553799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab150ef-d46e-4662-8c8d-01c46c366c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:57.554286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab150ef-d46e-4662-8c8d-01c46c366c0c None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:57.555108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab150ef-d46e-4662-8c8d-01c46c366c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:57.556714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab150ef-d46e-4662-8c8d-01c46c366c0c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:57.572432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 495/989] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:42:57 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:42:59.096756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd752318-747c-432f-89d0-e3ad3c2281ff None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.097284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd752318-747c-432f-89d0-e3ad3c2281ff None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.097284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd752318-747c-432f-89d0-e3ad3c2281ff None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.098691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 495/990] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:59.103877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c207-b33a-41f1-9942-faa2a1fee8e2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.104314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c207-b33a-41f1-9942-faa2a1fee8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.104500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8c207-b33a-41f1-9942-faa2a1fee8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.122913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b5f8c207-b33a-41f1-9942-faa2a1fee8e2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:59.124116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b5f8c207-b33a-41f1-9942-faa2a1fee8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:59.144202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:59.200593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 496/991] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:42:59.467562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190377a-b348-48bb-b55b-f9ecd3ebc942 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.467961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190377a-b348-48bb-b55b-f9ecd3ebc942 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.468138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190377a-b348-48bb-b55b-f9ecd3ebc942 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.470166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 496/992] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:59.472766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c207-b33a-41f1-9942-faa2a1fee8e2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:59.475094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fee922-418a-4c90-847c-a79481593ba9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.475397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fee922-418a-4c90-847c-a79481593ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.475654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fee922-418a-4c90-847c-a79481593ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.494614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d1fee922-418a-4c90-847c-a79481593ba9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:59.495810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d1fee922-418a-4c90-847c-a79481593ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:59.527521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:59.569014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 497/993] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:59.570272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b974-dd4a-4c0c-b17a-bc42c15b7cb6 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.570560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b974-dd4a-4c0c-b17a-bc42c15b7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.570834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b974-dd4a-4c0c-b17a-bc42c15b7cb6 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.572071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 498/994] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:42:59.577976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2eb8-baf8-428e-99f6-66aa997646b3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.577976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2eb8-baf8-428e-99f6-66aa997646b3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.578120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2eb8-baf8-428e-99f6-66aa997646b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.588849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8c207-b33a-41f1-9942-faa2a1fee8e2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:59.596566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-031e2eb8-baf8-428e-99f6-66aa997646b3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:42:59.597888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-031e2eb8-baf8-428e-99f6-66aa997646b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:42:59.624675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:59.625307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.625616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.625897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] PATH_INFO: `/v3/services/image` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.626485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:59.627848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:59.637049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:59.638064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:59.639210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 497/995] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 24 08:42:59 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:42:59.644266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:59.663662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:59.674538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 499/996] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:42:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:42:59.746455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359d62c-85b9-4794-8de1-c32605a123ba None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:59.780064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:59.780883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.781310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.782388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.783629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] RBAC: Adding query filter params (name=image) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:59.784081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:59.785669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:59.790661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 498/997] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:42:59.796597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2eb8-baf8-428e-99f6-66aa997646b3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:59.839826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:59.902283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:59.909936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2eb8-baf8-428e-99f6-66aa997646b3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:59.922645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:42:59.943495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd174ea-a861-471f-97fb-f5ad0935e82c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:42:59.946256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:59.946875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.947164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.947437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.948071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] RBAC: Adding query filter params (type=image) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:42:59.948405 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:59.949883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:59.955082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 500/998] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:42:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:42:59.955928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:42:59.981809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:42:59.982560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:42:59.982962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:42:59.983241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:42:59.983901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:42:59.985416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:42:59.994880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:42:59.995964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:42:59.997139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 499/999] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:42:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:00.009180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:00.078343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefec581-ce48-40a4-adb3-c66cfed5d22a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.118168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab546fd6-a25c-4a06-baca-85bebd042983 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.118680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.119162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.119444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.122944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.122944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.122944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:00.131132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:00.132118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 08:43:00.133003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:00.136543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 501/1000] 10.222.0.42 () {56 vars in 1126 bytes} [Wed Aug 24 08:42:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:00.138150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:00.153993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.154868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.155153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.155430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.156068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:00.156375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.157850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.163503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 500/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:43:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:00.168901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:00.169877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:00.185695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:00.254854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9966-da23-4f2c-88cd-859c18133c63 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.284341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b683b9d-c962-451b-9ad4-72cee7699e40 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.290745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.291364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.291636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.291915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.292589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:00.292894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.294275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.304064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 502/1002] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:43:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:00.305033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:00.321079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.321691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.321976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.322545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.322893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:00.323201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.324594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.330025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 501/1003] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:43:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:00.336350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:00.409200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:00.413972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:00.424040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f75803-5bbb-4ff0-8dbd-c9f6274b1839 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.445651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26002f-be00-4636-b961-c39e8c29ac18 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.462021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.462928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.463446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.463868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.464712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:00.465178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.466865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.472971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 503/1004] 10.222.0.42 () {56 vars in 1122 bytes} [Wed Aug 24 08:43:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:00.478470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:00.486258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.486938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.487224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.487493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.488229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] RBAC: Adding query filter params (interface=public, service_id=8a25598312cb480dab604ee7f602108d, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:00.488575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.490356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.496422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 502/1005] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:43:00 2022] GET /identity/v3/endpoints?service_id=8a25598312cb480dab604ee7f602108d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:00.502167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:00.595479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7b77-d02c-48cb-aa30-4fd8406b0869 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.618372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9902c5-1bab-4f5a-8263-4006edf8274c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:00.638165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22071128-c4d8-40f1-8da3-b03667a7bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.639299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22071128-c4d8-40f1-8da3-b03667a7bfc6 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.639582 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22071128-c4d8-40f1-8da3-b03667a7bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.639854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22071128-c4d8-40f1-8da3-b03667a7bfc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.640706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22071128-c4d8-40f1-8da3-b03667a7bfc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.643177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22071128-c4d8-40f1-8da3-b03667a7bfc6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.651669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26414-4a9d-4f47-bda3-e1a2f69114fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:00.652343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26414-4a9d-4f47-bda3-e1a2f69114fb None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:00.652696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26414-4a9d-4f47-bda3-e1a2f69114fb None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:00.652949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26414-4a9d-4f47-bda3-e1a2f69114fb None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:00.653621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c26414-4a9d-4f47-bda3-e1a2f69114fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:00.655003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c26414-4a9d-4f47-bda3-e1a2f69114fb None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:00.657361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:00.672417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 504/1006] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:43:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:43:00.672998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 503/1007] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:43:00 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:43:01.899509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3bc5a-0276-404d-907c-25add12b7004 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:01.900035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3bc5a-0276-404d-907c-25add12b7004 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:01.900035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3bc5a-0276-404d-907c-25add12b7004 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:01.901523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 505/1008] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:01.906503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dad4d-248a-4a51-88a7-9a8754fa17e5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:01.907371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dad4d-248a-4a51-88a7-9a8754fa17e5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:01.907587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9dad4d-248a-4a51-88a7-9a8754fa17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:01.925334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0e9dad4d-248a-4a51-88a7-9a8754fa17e5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:01.926517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0e9dad4d-248a-4a51-88a7-9a8754fa17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:01.998478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 504/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:02.268924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3bc5a-0276-404d-907c-25add12b7004 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:02.284725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:02.376217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3bc5a-0276-404d-907c-25add12b7004 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:02.410388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a049a8-6938-4c7d-80f1-e17079e522c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:02.410996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a049a8-6938-4c7d-80f1-e17079e522c9 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:02.411285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a049a8-6938-4c7d-80f1-e17079e522c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:02.411558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a049a8-6938-4c7d-80f1-e17079e522c9 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:02.412212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a049a8-6938-4c7d-80f1-e17079e522c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:02.413750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a049a8-6938-4c7d-80f1-e17079e522c9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:02.432558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 506/1010] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:43:02 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:02.582996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851fd5-0cee-4bfb-806d-f4f4bd32f40f None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:02.583291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851fd5-0cee-4bfb-806d-f4f4bd32f40f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:02.583571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851fd5-0cee-4bfb-806d-f4f4bd32f40f None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:02.585095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 505/1011] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:02.590258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b3c1-9c64-4729-9582-e8f00f9c4284 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:02.590554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b3c1-9c64-4729-9582-e8f00f9c4284 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:02.590839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56b3c1-9c64-4729-9582-e8f00f9c4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:02.600162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79733efe-b757-48c3-94b6-2463c987ad7f None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:02.600767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79733efe-b757-48c3-94b6-2463c987ad7f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:02.601351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79733efe-b757-48c3-94b6-2463c987ad7f None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:02.602878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 506/1012] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:43:02.608227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c85723-cced-426f-8ce9-56a992ec36e2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:02.608595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c85723-cced-426f-8ce9-56a992ec36e2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:02.608976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c85723-cced-426f-8ce9-56a992ec36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:02.609705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8f56b3c1-9c64-4729-9582-e8f00f9c4284 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:02.611052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8f56b3c1-9c64-4729-9582-e8f00f9c4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:02.627163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-65c85723-cced-426f-8ce9-56a992ec36e2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:02.628355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-65c85723-cced-426f-8ce9-56a992ec36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:02.680228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:02.687654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 507/1013] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:02 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:02.704271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 507/1014] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:02 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:43:02.952257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56b3c1-9c64-4729-9582-e8f00f9c4284 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:02.973093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c85723-cced-426f-8ce9-56a992ec36e2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:03.042732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:03.057129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56b3c1-9c64-4729-9582-e8f00f9c4284 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:03.087760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c85723-cced-426f-8ce9-56a992ec36e2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:03.094496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:03.095270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:03.095558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:03.095834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:03.096449 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:03.097952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:03.107290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:03.108271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:03.109174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 508/1015] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:43:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:03.114999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:03.125280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:03.125948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:03.126237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:03.126517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:03.127622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:03.129119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:03.132436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 508/1016] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:03.136295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:03.180068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:03.226603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae2c9e-6c6e-4b1b-b1e6-c14d5ae26b0e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:03.236673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e7fa-467f-44f8-a3ae-aa34ff982c04 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:03.260605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:03.263592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:03.264744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:03.265174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:03.265621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:03.266471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:03.266915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:03.268465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:03.272049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:03.272680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:03.272963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:03.273237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:03.273882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:03.274550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 509/1017] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:43:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:03.275289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:03.280111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:03.304849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 509/1018] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:43:03 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:03.394896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f7642-a66f-4856-bdbf-f84a2c52e99e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:03.423620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:03.433621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c1f78-a18f-4bcf-8e34-c896a820b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:03.434524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c1f78-a18f-4bcf-8e34-c896a820b362 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:03.435011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c1f78-a18f-4bcf-8e34-c896a820b362 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:03.435434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c1f78-a18f-4bcf-8e34-c896a820b362 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:03.436234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c1f78-a18f-4bcf-8e34-c896a820b362 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:03.436756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c1f78-a18f-4bcf-8e34-c896a820b362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:03.438751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c1f78-a18f-4bcf-8e34-c896a820b362 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:03.448415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 510/1019] 10.222.0.42 () {56 vars in 1112 bytes} [Wed Aug 24 08:43:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:03.450375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:03.559605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3957d2-95a7-445b-bfdc-7624d057da62 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:03.602079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0841a53-806c-411b-bb21-c9ae45957cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:03.602692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0841a53-806c-411b-bb21-c9ae45957cef None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:03.602973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0841a53-806c-411b-bb21-c9ae45957cef None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:03.603248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0841a53-806c-411b-bb21-c9ae45957cef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:03.603928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0841a53-806c-411b-bb21-c9ae45957cef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:03.605323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0841a53-806c-411b-bb21-c9ae45957cef None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:03.632410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 510/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:43:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:04.351459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83470671-d0a1-41a9-af5d-123e89ea749d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:04.352015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83470671-d0a1-41a9-af5d-123e89ea749d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:04.352015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83470671-d0a1-41a9-af5d-123e89ea749d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:04.353402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 511/1021] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:04.358586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9ebaa-310d-462e-a70c-6184e90f6e75 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:04.359002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9ebaa-310d-462e-a70c-6184e90f6e75 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:04.359144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9ebaa-310d-462e-a70c-6184e90f6e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:04.378252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e3c9ebaa-310d-462e-a70c-6184e90f6e75 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:04.379439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e3c9ebaa-310d-462e-a70c-6184e90f6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:04.404704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:04.456742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 511/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:04.724782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83470671-d0a1-41a9-af5d-123e89ea749d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:04.836703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83470671-d0a1-41a9-af5d-123e89ea749d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:04.870695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:04.871665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:04.872150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:04.872656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] PATH_INFO: `/v3/services/image` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:04.873442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:04.875108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:04.884525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:04.885538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:43:04.886373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:04.889508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 512/1023] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 24 08:43:04 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:04.895801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9ebaa-310d-462e-a70c-6184e90f6e75 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:04.993498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9ebaa-310d-462e-a70c-6184e90f6e75 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:05.027299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:05.027910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.028192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.028509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.029146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:05.029449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:05.030869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:05.040886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 512/1024] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:05.042462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:05.099848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:05.145309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee21133-de4d-486f-afed-363cf28b1414 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:05.178890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ec8a-7685-428f-8b2a-666ee1448fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:05.179502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ec8a-7685-428f-8b2a-666ee1448fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.179780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ec8a-7685-428f-8b2a-666ee1448fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.180057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ec8a-7685-428f-8b2a-666ee1448fa4 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.180717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8ec8a-7685-428f-8b2a-666ee1448fa4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:05.181018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8ec8a-7685-428f-8b2a-666ee1448fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:05.182383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8ec8a-7685-428f-8b2a-666ee1448fa4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:05.187478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 513/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:05.193327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:05.217896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:05.259489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a4a6-a8eb-4bda-83aa-b390a52bbe4e None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.259781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a4a6-a8eb-4bda-83aa-b390a52bbe4e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.259968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a4a6-a8eb-4bda-83aa-b390a52bbe4e None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.261481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 514/1026] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:05.267014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25baf-c9dc-4263-9ffe-32e844240faf None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.267301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25baf-c9dc-4263-9ffe-32e844240faf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.267574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c25baf-c9dc-4263-9ffe-32e844240faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.286329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-91c25baf-c9dc-4263-9ffe-32e844240faf None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:05.287520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-91c25baf-c9dc-4263-9ffe-32e844240faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:05.294436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f25717-b9ba-4629-b74c-934e5b5fafe6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:05.329478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:05.330077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.330382 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.330652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.331353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] RBAC: Adding query filter params (interface=public, service_id=91a66734c985464796ff50d1c323ffc1, region_id=RegionOne) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:05.331663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:05.333042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:05.337925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 513/1027] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:43:05 2022] GET /identity/v3/endpoints?service_id=91a66734c985464796ff50d1c323ffc1&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:05.343412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:05.356953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 515/1028] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:43:05.431452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:05.448161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100a11e-2d02-476b-84a2-0b04239d47f9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:05.481290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b107362-82c0-490d-b0ba-d48c776e9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:05.481890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b107362-82c0-490d-b0ba-d48c776e9dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.482167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b107362-82c0-490d-b0ba-d48c776e9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.482437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b107362-82c0-490d-b0ba-d48c776e9dc7 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.483040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b107362-82c0-490d-b0ba-d48c776e9dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:05.484400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b107362-82c0-490d-b0ba-d48c776e9dc7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:05.497667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 514/1029] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:43:05 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:43:05.637468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c25baf-c9dc-4263-9ffe-32e844240faf None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:05.641941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0edf96-6d98-4308-8a66-da222c6130b8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.642235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0edf96-6d98-4308-8a66-da222c6130b8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.646705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0edf96-6d98-4308-8a66-da222c6130b8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.646705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 515/1030] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:43:05.650051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff3f34-0cd7-46d0-b1c6-766027039469 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.650661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff3f34-0cd7-46d0-b1c6-766027039469 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.650956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff3f34-0cd7-46d0-b1c6-766027039469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.670488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-24ff3f34-0cd7-46d0-b1c6-766027039469 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:05.671685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-24ff3f34-0cd7-46d0-b1c6-766027039469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:05.694829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:05.747649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c25baf-c9dc-4263-9ffe-32e844240faf None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:05.753196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 516/1031] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:43:05.784567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:05.785460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.785883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.786295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.787523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:05.789180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:05.790897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 516/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:05.796573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff3f34-0cd7-46d0-b1c6-766027039469 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:05.879289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:05.899950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff3f34-0cd7-46d0-b1c6-766027039469 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:05.934140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:05.934807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:05.935091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:05.935362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:05.936019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:05.938324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:05.968416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 517/1033] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:43:05 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:06.031135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:06.142848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973080-1414-4c72-8bdf-82ba5a69c024 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:06.162956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:06.185169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:06.186132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:06.186650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:06.187113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:06.198252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:06.202955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:06.206543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:06.207427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 517/1034] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 24 08:43:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:06.210599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:06.312401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47d2de-37e9-4301-9378-69b615cecd34 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:06.346139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:06.346748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:06.347027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:06.347301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:06.347969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:06.348275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:06.349666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:06.352000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:06.361493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 518/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 24 08:43:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:06.366883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:06.466936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5c691-134b-42af-9a37-285f82cc6686 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:06.504591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:06.505243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:06.505526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:06.505861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:06.517238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:06.518704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:06.533761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:06.534724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:43:06.535626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:06.535626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:06.535626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:06.536318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 518/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:06.540781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:06.650737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a106b-e3b1-416c-af68-b5cff2b14d10 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:06.684279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:06.684913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:06.685197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:06.685490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:06.686103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:06.686410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:06.688476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:06.699479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 519/1037] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:06.705461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:06.734088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:06.807182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38253c76-db75-41d7-8b86-e276f8cebe13 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:06.839998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:06.840707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:06.840989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:06.841263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:06.848982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:06.850432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:43:06.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:06.862867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:43:06.863815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:06.867871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 519/1038] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:43:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:06.868896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:06.927349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:06.972177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6651c-9ad5-46fb-ba17-91b320466de4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:07.006659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:07.007191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.007474 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.007750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.008544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:07.008854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:07.010303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:07.028770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 520/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:43:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:07.034278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:07.124914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:07.139103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864d972-16dd-447c-8e0b-e525c9e13024 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:07.172407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fdd72-5032-443e-8780-2e741b7d6d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:07.173020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdd72-5032-443e-8780-2e741b7d6d49 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.173301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdd72-5032-443e-8780-2e741b7d6d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.173573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fdd72-5032-443e-8780-2e741b7d6d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.240130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fdd72-5032-443e-8780-2e741b7d6d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:07.241615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fdd72-5032-443e-8780-2e741b7d6d49 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:07.327654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:07.341416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 520/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:07 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:07.347023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:07.423030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fd01-dd80-4cb3-97f4-841eb05d6230 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.423545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fd01-dd80-4cb3-97f4-841eb05d6230 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.423545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fd01-dd80-4cb3-97f4-841eb05d6230 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.425054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 521/1041] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:43:07.429866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e09-0703-47f9-8f28-9979eaccdffa None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.430150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e09-0703-47f9-8f28-9979eaccdffa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.430418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f3e09-0703-47f9-8f28-9979eaccdffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.447813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd9cfc-fa08-4ba3-a7f1-5e800686def9 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:07.448499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-358f3e09-0703-47f9-8f28-9979eaccdffa None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:07.449675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-358f3e09-0703-47f9-8f28-9979eaccdffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:07.464833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:07.484230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:07.485425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.485711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.485988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.496359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:07.497829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:07.512631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:07.513582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:43:07.515327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:07.515327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:07.515327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:07.515327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 521/1042] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:07.520170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:07.520786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 522/1043] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 08:43:07.641121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbdbc7-402b-41d7-bcc0-25a42ce91902 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:07.675018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:07.675625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.675906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.676186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.676859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:07.677164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:07.678523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:07.696449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 522/1044] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:07.697665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e09-0703-47f9-8f28-9979eaccdffa None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:07.795556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:07.800715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f3e09-0703-47f9-8f28-9979eaccdffa None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:07.818134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:07.830781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:07.837172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:07.837812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.838095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.838368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.845743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:07.847198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:43:07.858767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:07.860294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:07.861233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 523/1045] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:07.866446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:07.909378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9089c2-2b23-43bb-b090-9f8c1fbcde97 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:07.947169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4374f20-7600-48fa-adee-90282fc8e06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:07.948192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f20-7600-48fa-adee-90282fc8e06f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.948503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f20-7600-48fa-adee-90282fc8e06f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.948778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374f20-7600-48fa-adee-90282fc8e06f None admin] PATH_INFO: `/v3/services/image` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.949369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374f20-7600-48fa-adee-90282fc8e06f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:07.950716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374f20-7600-48fa-adee-90282fc8e06f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d4374f20-7600-48fa-adee-90282fc8e06f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:07.959410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:07.960772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:07.962340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 523/1046] 10.222.0.42 () {56 vars in 1105 bytes} [Wed Aug 24 08:43:07 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:07.963367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff3e4-4bf1-4959-8b4e-c8d942b26a08 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:07.963367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff3e4-4bf1-4959-8b4e-c8d942b26a08 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:07.963367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ff3e4-4bf1-4959-8b4e-c8d942b26a08 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:07.964021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 524/1047] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:07.966287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff3e4-4bf1-4959-8b4e-c8d942b26a08 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:07.975813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c0b54-6199-475d-b56e-a38670eab25e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.009678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5a84d-b6cb-4c9b-81c8-81a06b4e2184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.010276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a84d-b6cb-4c9b-81c8-81a06b4e2184 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.010553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a84d-b6cb-4c9b-81c8-81a06b4e2184 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.010824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5a84d-b6cb-4c9b-81c8-81a06b4e2184 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.011505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a84d-b6cb-4c9b-81c8-81a06b4e2184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:08.011808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a84d-b6cb-4c9b-81c8-81a06b4e2184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:08.013263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5a84d-b6cb-4c9b-81c8-81a06b4e2184 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:08.025115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 524/1048] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:08.026275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b8c39-6a3d-4ac4-97d2-a340b8852754 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.026557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b8c39-6a3d-4ac4-97d2-a340b8852754 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.026829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b8c39-6a3d-4ac4-97d2-a340b8852754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.044294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-493b8c39-6a3d-4ac4-97d2-a340b8852754 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:08.045511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-493b8c39-6a3d-4ac4-97d2-a340b8852754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:08.063964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:08.073861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ff3e4-4bf1-4959-8b4e-c8d942b26a08 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.074734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:08.107777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.108309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.108616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.108886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.109532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] RBAC: Adding query filter params (name=image) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:08.109830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:08.111202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:08.113047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 525/1049] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:08.113873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b8c39-6a3d-4ac4-97d2-a340b8852754 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:08.119116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 525/1050] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:08.124715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:08.227040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b8c39-6a3d-4ac4-97d2-a340b8852754 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.233857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78080-807a-481e-93e2-b7f69ff2f51d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.262848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.263447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.263990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.264262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.265033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] RBAC: Adding query filter params (role.id=9bb76ebe298e4c0b811f1a1114f53a3a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=a517cf1b373445fd9e98c4e703732153) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:08.265340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:08.267298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:08.271707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.272312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.280648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.280850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 526/1051] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:08 2022] GET /identity/v3/role_assignments?user.id=a517cf1b373445fd9e98c4e703732153&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=9bb76ebe298e4c0b811f1a1114f53a3a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:08.280949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.280949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] RBAC: Adding query filter params (type=image) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:08.280949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:08.280949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:08.286573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 526/1052] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:08.292867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:08.326987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:08.386743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:08.404521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ad002-2b50-42cb-9625-784d94ef9f70 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.409147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:08.444448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.445158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.445875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.446160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.446895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:08.448197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:08.471527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 527/1053] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:43:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:08.495048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa7259-b4e1-4b8b-a0ae-02f476818a19 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.542176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.542830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.543113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.543559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.556287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:08.561292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:08.562264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:08.564237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 527/1054] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:08.569806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:08.666425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:08.679336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7a572-f161-4819-96b3-1a3c0649ffa3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.714051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.716117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.716117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.716117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.716117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:08.716467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:08.717572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:08.727371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 528/1055] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:08.735047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:08.815956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:08.840362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ce903-6485-47b7-9ede-a486b808feb3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:08.874870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:08.876059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:08.876342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:08.876643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] PATH_INFO: `/v3/users/007862da502a41acbd1e5c56cbef326f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:08.890230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] RBAC: Authorizing `identity:get_user(user_id=007862da502a41acbd1e5c56cbef326f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:08.891707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:08.898131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 528/1056] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:08 2022] GET /identity/v3/users/007862da502a41acbd1e5c56cbef326f => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:08.899677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:09.002940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0e9d0-c4c9-4ec7-a39a-fde833df2218 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:09.037003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:09.037609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:09.037885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:09.038155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:09.056119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:09.104835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:09.106382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:09.208470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 529/1057] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:09.209837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:09.308880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975ece4-4e96-4845-9888-31cdf51b2e50 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:09.342594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ffeee-fcab-498a-a654-575d93ba5553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:09.343220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ffeee-fcab-498a-a654-575d93ba5553 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:09.343502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ffeee-fcab-498a-a654-575d93ba5553 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:09.344261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ffeee-fcab-498a-a654-575d93ba5553 None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:09.345465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ffeee-fcab-498a-a654-575d93ba5553 None admin] RBAC: Authorizing `identity:get_project(project_id=4b132bd36d874539a0264f5038dd6b4b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:09.346878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ffeee-fcab-498a-a654-575d93ba5553 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:09.348515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 529/1058] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:09 2022] GET /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:09.354557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:09.407475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:09.457448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848575b0-3df8-44c2-a13a-ed15a816bf43 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:09.492034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147087df-eddf-4712-8881-c0f153822f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:09.492672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147087df-eddf-4712-8881-c0f153822f79 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:09.492952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147087df-eddf-4712-8881-c0f153822f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:09.493221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147087df-eddf-4712-8881-c0f153822f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:09.493941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147087df-eddf-4712-8881-c0f153822f79 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=4b132bd36d874539a0264f5038dd6b4b, user.id=007862da502a41acbd1e5c56cbef326f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:09.494250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147087df-eddf-4712-8881-c0f153822f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:09.495684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147087df-eddf-4712-8881-c0f153822f79 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:09.508475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 530/1059] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:09 2022] GET /identity/v3/role_assignments?user.id=007862da502a41acbd1e5c56cbef326f&scope.project.id=4b132bd36d874539a0264f5038dd6b4b&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:10.191063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9447c-231d-4f2b-9b30-7534836f82f8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:10.191586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9447c-231d-4f2b-9b30-7534836f82f8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:10.191586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9447c-231d-4f2b-9b30-7534836f82f8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:10.193112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 530/1060] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:10.198157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca07fb-2395-4476-a9e2-c5d33ce51d4b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:10.198441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca07fb-2395-4476-a9e2-c5d33ce51d4b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:10.198713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca07fb-2395-4476-a9e2-c5d33ce51d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:10.216288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c8ca07fb-2395-4476-a9e2-c5d33ce51d4b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:10.217474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c8ca07fb-2395-4476-a9e2-c5d33ce51d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:10.285442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 531/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:10.427943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df8a91-5231-45af-b805-c89fb4545a51 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:10.428302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df8a91-5231-45af-b805-c89fb4545a51 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:10.428532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df8a91-5231-45af-b805-c89fb4545a51 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:10.430107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 531/1062] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:10.435293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760915c-123f-442e-a87f-43d591f63ad0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:10.435584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760915c-123f-442e-a87f-43d591f63ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:10.435860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760915c-123f-442e-a87f-43d591f63ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:10.454507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f760915c-123f-442e-a87f-43d591f63ad0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:10.455607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f760915c-123f-442e-a87f-43d591f63ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:10.495693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:10.525172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 532/1063] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:10.556193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df8a91-5231-45af-b805-c89fb4545a51 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:10.559145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:10.665800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df8a91-5231-45af-b805-c89fb4545a51 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:10.699061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:10.699685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:10.699965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:10.700236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:10.710178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:10.714767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:10.715699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:10.721159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 532/1064] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 24 08:43:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:10.722744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760915c-123f-442e-a87f-43d591f63ad0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:10.790956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:10.834434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760915c-123f-442e-a87f-43d591f63ad0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:10.856886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:10.878703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:10.879640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:10.880168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:10.880643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:10.881486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:10.881996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:10.883711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:10.893568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 533/1065] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 24 08:43:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:10.898993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:10.902030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c6058-91aa-4032-9bf3-54d295c0488c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:10.935452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:10.937663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:10.938276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:10.938555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:10.938833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.005382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52192b7-d5eb-4cc1-bbe1-efa9235d3347 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.008401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.009867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.042588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.043384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.043665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.044716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.056123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.057627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:11.071974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:11.073018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:43:11.073929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:11.073929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:11.073929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:11.073929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 534/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:11.074906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:11.078979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.120107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 533/1067] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 08:43:11.125758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.183663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:11.195674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae28b-93e7-4fc8-b8d5-64cda0d01166 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.229987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27c408-27fc-43e9-874b-369dd5ceb4d6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.236475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.237083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.237358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.237629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.238323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:11.238622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.240027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.252891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 535/1068] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:11.258957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.266725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.267360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.267640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.267909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.278316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.279745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:11.294809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:11.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:43:11.298122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:11.298122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:11.298122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:11.298122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 534/1069] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:11.302253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.319001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:11.369974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21b5af-9993-4550-b80a-2a5e252a3c0e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.405429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4097-8a54-40cc-b236-1845dbb054ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.406065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4097-8a54-40cc-b236-1845dbb054ab None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.406451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4097-8a54-40cc-b236-1845dbb054ab None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.406722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4097-8a54-40cc-b236-1845dbb054ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.410460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098a77b-6f5d-4700-8f89-b801eef70d11 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.413833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4097-8a54-40cc-b236-1845dbb054ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.415278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4097-8a54-40cc-b236-1845dbb054ab None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-246d4097-8a54-40cc-b236-1845dbb054ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:43:11.426996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:11.428132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:11.429126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 536/1070] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:11.429801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9bb9-222b-4247-9fd4-7acaee5fcecc None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.429801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9bb9-222b-4247-9fd4-7acaee5fcecc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.429801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de9bb9-222b-4247-9fd4-7acaee5fcecc None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.431108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 537/1071] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:11.435417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9bb9-222b-4247-9fd4-7acaee5fcecc None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.446866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:11.448961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8ebf0-37b8-4d35-9d12-52e79629d326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.449569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ebf0-37b8-4d35-9d12-52e79629d326 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.449852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ebf0-37b8-4d35-9d12-52e79629d326 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.450122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8ebf0-37b8-4d35-9d12-52e79629d326 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.450763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8ebf0-37b8-4d35-9d12-52e79629d326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:11.451076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8ebf0-37b8-4d35-9d12-52e79629d326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.452431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8ebf0-37b8-4d35-9d12-52e79629d326 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.476437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 535/1072] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:11.476437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf482c-0a16-49fd-8eee-476c375d3d97 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.476437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf482c-0a16-49fd-8eee-476c375d3d97 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.476437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf482c-0a16-49fd-8eee-476c375d3d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.489673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-19cf482c-0a16-49fd-8eee-476c375d3d97 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:11.490924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-19cf482c-0a16-49fd-8eee-476c375d3d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:11.547659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de9bb9-222b-4247-9fd4-7acaee5fcecc None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.565178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 536/1073] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:11.589671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.590298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.590581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.590853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.591603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:11.591911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.593405 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.614068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 538/1074] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:11.620178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf482c-0a16-49fd-8eee-476c375d3d97 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.623727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:11.727786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf482c-0a16-49fd-8eee-476c375d3d97 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.762540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.763180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.763468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.764008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.774301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.775743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:11.790631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:11.791594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:43:11.792567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:11.792567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:11.792567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:11.792567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 537/1075] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:11.798305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.843903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.864880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:11.899196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529c640-68b9-45e5-8289-a472be6db30f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.901982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:11.933834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.934441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.934720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.934993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.935635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:11.935938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:11.937347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:11.948888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe30fa-c2d7-474b-9d7a-8765d938a5ed None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:11.949330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 539/1076] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:11.955502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:11.983050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:11.983728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:11.984009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:11.984808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:11.995166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:11.999834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:12.001461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:12.002307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 538/1077] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:12.007560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:12.056215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3f0a9-0f7b-49c3-aa20-844806ff787c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:12.080941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:12.089948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:12.090567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:12.090843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:12.091113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:12.097589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:12.099020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:12.104519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a1b8a-fbac-4b2d-88c8-275a307bdefa None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:43:12.111207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:12.112264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:12.113288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 540/1078] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:12.118067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:12.123046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:12.141838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:12.142436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:12.142718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:12.142987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:12.143644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:12.143950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:12.145330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:12.153841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 539/1079] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:12.159544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:12.222909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc5fb7-7abe-4094-a615-b0bd251503c8 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:12.257835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bd7d9-0e51-4987-b94f-73d05da7da56 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:12.262223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:12.262841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:12.263122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:12.263397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:12.264353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:12.264696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:12.266142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:12.277988 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 541/1080] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:12.284349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:12.291225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:12.291847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:12.292125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:12.292404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] PATH_INFO: `/v3/users/007862da502a41acbd1e5c56cbef326f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:12.293554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] RBAC: Authorizing `identity:get_user(user_id=007862da502a41acbd1e5c56cbef326f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:12.294953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:12.296640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 540/1081] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:12 2022] GET /identity/v3/users/007862da502a41acbd1e5c56cbef326f => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:12.302675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:12.333320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:12.348720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:12.387006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682061-762f-4941-b41e-8dea11605a56 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:12.401218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757c4c6-0aa2-46c8-be1b-db692fa0ebdd None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:12.421054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:12.421711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:12.422548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:12.422823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/a517cf1b373445fd9e98c4e703732153/roles/9bb76ebe298e4c0b811f1a1114f53a3a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:12.425016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=a517cf1b373445fd9e98c4e703732153, role_id=9bb76ebe298e4c0b811f1a1114f53a3a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:12.426448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:12.435025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2987ab-07a9-48c6-b0f3-b273b2e1fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:12.435649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2987ab-07a9-48c6-b0f3-b273b2e1fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:12.435930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2987ab-07a9-48c6-b0f3-b273b2e1fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:12.436202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2987ab-07a9-48c6-b0f3-b273b2e1fbf1 None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:12.437339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2987ab-07a9-48c6-b0f3-b273b2e1fbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=4b132bd36d874539a0264f5038dd6b4b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:12.439393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2987ab-07a9-48c6-b0f3-b273b2e1fbf1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:12.439574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 542/1082] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:43:12 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/a517cf1b373445fd9e98c4e703732153/roles/9bb76ebe298e4c0b811f1a1114f53a3a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:43:12.446182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 541/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:12 2022] GET /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:12.447174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:12.552528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc74bb0-a974-48af-9423-3a8a1d6997a3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:12.560417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:12.590305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8b27f-da06-40fc-a23a-80885fdb60e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:12.590912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8b27f-da06-40fc-a23a-80885fdb60e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:12.591188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8b27f-da06-40fc-a23a-80885fdb60e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:12.591458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8b27f-da06-40fc-a23a-80885fdb60e4 None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b/users/007862da502a41acbd1e5c56cbef326f/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:12.593372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8b27f-da06-40fc-a23a-80885fdb60e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b132bd36d874539a0264f5038dd6b4b, user_id=007862da502a41acbd1e5c56cbef326f, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:12.595447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8b27f-da06-40fc-a23a-80885fdb60e4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:12.610006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 543/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:43:12 2022] PUT /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b/users/007862da502a41acbd1e5c56cbef326f/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:43:14.359034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef89af-8f0e-4b56-9aa1-ceb1d5f52ff3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:14.359600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef89af-8f0e-4b56-9aa1-ceb1d5f52ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:14.359600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef89af-8f0e-4b56-9aa1-ceb1d5f52ff3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:14.360950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 542/1085] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:14.366927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15fb6-91be-47d8-993f-aa15665a29e3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:14.367330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15fb6-91be-47d8-993f-aa15665a29e3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:14.367479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15fb6-91be-47d8-993f-aa15665a29e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:14.385450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4bd15fb6-91be-47d8-993f-aa15665a29e3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:14.386638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4bd15fb6-91be-47d8-993f-aa15665a29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:14.453172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 544/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:14.479730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f4d70-ce97-4420-987a-b6f32fa2da68 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:14.480017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f4d70-ce97-4420-987a-b6f32fa2da68 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:14.480293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f4d70-ce97-4420-987a-b6f32fa2da68 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:14.481639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 543/1087] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:14.487553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08588c8-1c4f-4551-bd1a-f10aea94ddd6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:14.487848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08588c8-1c4f-4551-bd1a-f10aea94ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:14.488133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08588c8-1c4f-4551-bd1a-f10aea94ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:14.505798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d08588c8-1c4f-4551-bd1a-f10aea94ddd6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:14.506983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d08588c8-1c4f-4551-bd1a-f10aea94ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:14.572088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 545/1088] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:14.732208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f4d70-ce97-4420-987a-b6f32fa2da68 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:14.831771 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f4d70-ce97-4420-987a-b6f32fa2da68 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:14.845086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:14.847056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08588c8-1c4f-4551-bd1a-f10aea94ddd6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:14.865931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:14.866557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:14.866838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:14.867111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:14.873770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:14.877661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:14.882473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:14.883449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:14.884289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 544/1089] 10.222.0.42 () {56 vars in 1120 bytes} [Wed Aug 24 08:43:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:14.889672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:14.953375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08588c8-1c4f-4551-bd1a-f10aea94ddd6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:14.989473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:14.990030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:14.990133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d9e68-31ee-4f14-a0f2-4a92f7721c71 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:14.990307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:14.990573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.002459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:15.007694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:15.008657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:15.009536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 546/1090] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:15.015001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.027348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.027951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.028230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.028537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.029196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:15.029493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.030841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.038988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 545/1091] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 24 08:43:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:15.045150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.079839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.104682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.120310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69984-74b6-455e-8b1f-2f5f70316a40 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.144447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8939acd-bcdf-491d-a6ac-a96ab26884ab None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.154080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.154682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.154959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.155232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.155887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:15.156209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.157614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.165551 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 547/1092] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:15.171201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.178187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.178816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.179095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.179367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.189776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.191201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:15.204681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:15.205639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:43:15.206550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:15.206550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:15.206550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:15.206550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 546/1093] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:43:15.211520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.275521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01be95-54e5-449b-ba98-e6e4870ceae3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.296962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.308964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.309504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7e4c2-137c-4d25-a49c-239078010b75 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.309616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.309894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.310226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] PATH_INFO: `/v3/users/007862da502a41acbd1e5c56cbef326f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.311366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] RBAC: Authorizing `identity:get_user(user_id=007862da502a41acbd1e5c56cbef326f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.314585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.316200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 548/1094] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/users/007862da502a41acbd1e5c56cbef326f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:15.322007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.340873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.345274 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.346061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.346332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.346606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.347266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:15.347565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.348948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.360747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 547/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:15.366392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.422925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197ef6-53b3-489b-b2d4-b1ad16a7c983 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.461725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.462338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.462620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.462905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.471528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d564cf9-d354-43f1-a1c3-53f3c6848723 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.507063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.507695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.507979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.508253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.515373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.517439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:43:15.528504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:15.529459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:15.530800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 548/1096] 10.222.0.42 () {56 vars in 1093 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:15.532523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.533956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.535270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.546704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.550601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.634610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 549/1097] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 08:43:15.636054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f2752-3c48-411d-a94d-564cde039cc1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.641267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.669537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.670130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.670408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.670684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.671402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:15.672239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.673759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.690539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 549/1098] 10.222.0.42 () {56 vars in 1133 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:15.696205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.741648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495a637-0857-4b44-80ce-6079328a014a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.757831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.769690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:15.777294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.777926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.778207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.778482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.779682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] RBAC: Authorizing `identity:get_project(project_id=4b132bd36d874539a0264f5038dd6b4b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.781136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.783279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 550/1099] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:15.789474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:15.806286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147981f-c932-4ffd-9697-c507e28eca5c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.839639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.840235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.840572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.840842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.894802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da10fb5-c29d-4cca-bdd0-0505fa4af277 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:15.907201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.908698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.928597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:15.929189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:15.929466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:15.929736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:15.930446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=4b132bd36d874539a0264f5038dd6b4b, user.id=007862da502a41acbd1e5c56cbef326f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:15.930749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:15.932149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:15.938277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 551/1100] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/role_assignments?user.id=007862da502a41acbd1e5c56cbef326f&scope.project.id=4b132bd36d874539a0264f5038dd6b4b&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:15.974672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:16.014428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 550/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 08:43:16.021375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:16.072750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:16.125764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48659c08-62b7-44e6-8eec-f488ad39157c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:16.159361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:16.159996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:16.160280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:16.160585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:16.171011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:16.173082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:16.187017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:16.188107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:43:16.189066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:16.189066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:43:16.189066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:16.189066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 552/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:16.194160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:16.290858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad99bfe-b57e-43e0-8399-466f06626b1e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:16.324541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:16.325076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:16.325356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:16.325627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:16.326265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:16.326567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:16.328461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:16.339269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 551/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:16.345746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:16.440521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:16.443757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b830f-9cf7-480b-ac40-98e9f1a37c14 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:16.477441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:16.478064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:16.478345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:16.478617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:16.485577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:16.487017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:43:16.497785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:16.498825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:16.500425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 553/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:16.505473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:16.532708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:16.604250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe23650-a7ec-405a-bac1-f209e2b1f041 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:16.636984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d7381-cd85-43c5-81af-ec06407296fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:16.637586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d7381-cd85-43c5-81af-ec06407296fc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:16.637867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d7381-cd85-43c5-81af-ec06407296fc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:16.638138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d7381-cd85-43c5-81af-ec06407296fc None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:16.639090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d7381-cd85-43c5-81af-ec06407296fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:16.639393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d7381-cd85-43c5-81af-ec06407296fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:16.641348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d7381-cd85-43c5-81af-ec06407296fc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:16.653444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 552/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:16.660168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:16.759871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc9beb-78aa-42ce-98fd-8def6efb5aef None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:16.793943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d694e77-9cf0-44b5-a140-7c84a392f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:16.794542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694e77-9cf0-44b5-a140-7c84a392f20f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:16.794825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694e77-9cf0-44b5-a140-7c84a392f20f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:16.795100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d694e77-9cf0-44b5-a140-7c84a392f20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:16.795826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d694e77-9cf0-44b5-a140-7c84a392f20f None admin] RBAC: Adding query filter params (role.id=9bb76ebe298e4c0b811f1a1114f53a3a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=a517cf1b373445fd9e98c4e703732153) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:16.796138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d694e77-9cf0-44b5-a140-7c84a392f20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:16.798196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d694e77-9cf0-44b5-a140-7c84a392f20f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:16.804176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 554/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:16 2022] GET /identity/v3/role_assignments?user.id=a517cf1b373445fd9e98c4e703732153&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=9bb76ebe298e4c0b811f1a1114f53a3a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:17.892320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc810-65cd-43c3-b014-4d4640dd74a2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:17.892842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc810-65cd-43c3-b014-4d4640dd74a2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:17.892842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cc810-65cd-43c3-b014-4d4640dd74a2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:17.894145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 553/1107] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:17.899404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59689b5e-01c0-49cb-a1c8-22188a90921d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:17.899829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59689b5e-01c0-49cb-a1c8-22188a90921d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:17.899958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59689b5e-01c0-49cb-a1c8-22188a90921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:17.918707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-59689b5e-01c0-49cb-a1c8-22188a90921d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:17.919886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-59689b5e-01c0-49cb-a1c8-22188a90921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:17.936664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:17.984603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 555/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:18.253419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc810-65cd-43c3-b014-4d4640dd74a2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:18.337075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:18.353144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cc810-65cd-43c3-b014-4d4640dd74a2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:18.385673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415049ad-657c-4e3f-9ca4-3a566d22d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:18.386289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415049ad-657c-4e3f-9ca4-3a566d22d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:18.386569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415049ad-657c-4e3f-9ca4-3a566d22d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:18.386841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415049ad-657c-4e3f-9ca4-3a566d22d4d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:18.387947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415049ad-657c-4e3f-9ca4-3a566d22d4d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:18.389642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415049ad-657c-4e3f-9ca4-3a566d22d4d7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:18.391254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 554/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:18.397015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59689b5e-01c0-49cb-a1c8-22188a90921d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:18.492773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59689b5e-01c0-49cb-a1c8-22188a90921d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:18.525644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bc34e-9b64-4e2d-849e-5f6e367cdcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:18.526182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc34e-9b64-4e2d-849e-5f6e367cdcb8 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:18.526462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc34e-9b64-4e2d-849e-5f6e367cdcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:18.526732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc34e-9b64-4e2d-849e-5f6e367cdcb8 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:18.527359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bc34e-9b64-4e2d-849e-5f6e367cdcb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:18.528819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bc34e-9b64-4e2d-849e-5f6e367cdcb8 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:18.550511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 556/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:43:18 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:20.477145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4acb-42e2-4d71-b632-4697ed98d6a3 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:20.477678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4acb-42e2-4d71-b632-4697ed98d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:20.477678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad4acb-42e2-4d71-b632-4697ed98d6a3 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:20.479030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 555/1111] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:20.484294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60a740-d8a2-4fe0-a0f2-4254e910e234 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:20.484685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60a740-d8a2-4fe0-a0f2-4254e910e234 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:20.484897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60a740-d8a2-4fe0-a0f2-4254e910e234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:20.502852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fd60a740-d8a2-4fe0-a0f2-4254e910e234 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:20.504017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fd60a740-d8a2-4fe0-a0f2-4254e910e234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:20.506733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:20.569677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 557/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:20.842251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad4acb-42e2-4d71-b632-4697ed98d6a3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:20.941034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad4acb-42e2-4d71-b632-4697ed98d6a3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:20.976730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:20.977351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:20.977628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:20.977897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] PATH_INFO: `/v3/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:20.979261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] RBAC: Authorizing `identity:get_role(role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:20.980632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:20.981924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 556/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:20 2022] GET /identity/v3/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:20.988211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60a740-d8a2-4fe0-a0f2-4254e910e234 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:21.084194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60a740-d8a2-4fe0-a0f2-4254e910e234 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:21.116940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:21.117492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:21.117773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:21.118048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] PATH_INFO: `/v3/users/429ae3d5acee4055ac4e010d5000773f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:21.127836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:21.131290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] RBAC: Authorizing `identity:get_user(user_id=429ae3d5acee4055ac4e010d5000773f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:21.133228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:21.135069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 558/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:20 2022] GET /identity/v3/users/429ae3d5acee4055ac4e010d5000773f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:21.141331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:21.165199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:21.237666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8974d8-a152-42de-860c-7534cd6a6d73 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:21.271439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:21.272157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:21.272640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:21.272806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:21.336991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:21.338413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:21.360591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:21.435949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 557/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:21.442106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:21.538007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25153d06-86c4-48bc-9f2c-d986aae5c5a4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:21.570944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead9e7-b667-4d5f-8edd-b47d029cba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:21.571562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead9e7-b667-4d5f-8edd-b47d029cba08 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:21.571843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead9e7-b667-4d5f-8edd-b47d029cba08 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:21.572116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead9e7-b667-4d5f-8edd-b47d029cba08 None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:21.573256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aead9e7-b667-4d5f-8edd-b47d029cba08 None admin] RBAC: Authorizing `identity:get_project(project_id=4b132bd36d874539a0264f5038dd6b4b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:21.574701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aead9e7-b667-4d5f-8edd-b47d029cba08 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:21.576322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 559/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:21 2022] GET /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:21.582924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:21.677207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e15de76-f9d6-4e13-a576-6d5f29a238e6 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:21.699069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:21.711106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9038ba-21d6-4fc9-ac30-d88fca253ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:21.711701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9038ba-21d6-4fc9-ac30-d88fca253ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:21.711977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9038ba-21d6-4fc9-ac30-d88fca253ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:21.712248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9038ba-21d6-4fc9-ac30-d88fca253ba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:21.712998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9038ba-21d6-4fc9-ac30-d88fca253ba7 None admin] RBAC: Adding query filter params (role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=4b132bd36d874539a0264f5038dd6b4b, user.id=429ae3d5acee4055ac4e010d5000773f) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:21.713305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9038ba-21d6-4fc9-ac30-d88fca253ba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:21.714714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9038ba-21d6-4fc9-ac30-d88fca253ba7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:21.720494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 558/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:21 2022] GET /identity/v3/role_assignments?user.id=429ae3d5acee4055ac4e010d5000773f&scope.project.id=4b132bd36d874539a0264f5038dd6b4b&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:23.577628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7f26-35cf-48ca-811f-ee7ef1d855f3 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:23.578150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7f26-35cf-48ca-811f-ee7ef1d855f3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:23.578721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e7f26-35cf-48ca-811f-ee7ef1d855f3 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:23.579520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 560/1118] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:23.584701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca0c1a-2149-426c-a139-854566ba2abb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:23.585098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca0c1a-2149-426c-a139-854566ba2abb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:23.585250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca0c1a-2149-426c-a139-854566ba2abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:23.603825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b3ca0c1a-2149-426c-a139-854566ba2abb None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:23.605038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b3ca0c1a-2149-426c-a139-854566ba2abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:23.667520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 559/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:23.938480 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e7f26-35cf-48ca-811f-ee7ef1d855f3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:24.004609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:24.038567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e7f26-35cf-48ca-811f-ee7ef1d855f3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:24.071288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:24.071902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:24.072178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:24.072471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] PATH_INFO: `/v3/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:24.073836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] RBAC: Authorizing `identity:get_role(role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:24.075191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:24.076494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 561/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:23 2022] GET /identity/v3/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:24.082634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca0c1a-2149-426c-a139-854566ba2abb None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:24.179515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca0c1a-2149-426c-a139-854566ba2abb None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:24.195765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:24.212999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:24.213618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:24.213896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:24.214169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] PATH_INFO: `/v3/users/429ae3d5acee4055ac4e010d5000773f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:24.215280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] RBAC: Authorizing `identity:get_user(user_id=429ae3d5acee4055ac4e010d5000773f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:24.216803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:24.218878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 560/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:24 2022] GET /identity/v3/users/429ae3d5acee4055ac4e010d5000773f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:24.228565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:24.324529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e518-5187-4cd7-beb1-0e6ed1c3db88 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:24.358388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3edd96-a039-4f07-bc77-522d45f76d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:24.359112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3edd96-a039-4f07-bc77-522d45f76d9d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:24.359396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3edd96-a039-4f07-bc77-522d45f76d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:24.359672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3edd96-a039-4f07-bc77-522d45f76d9d None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:24.360817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3edd96-a039-4f07-bc77-522d45f76d9d None admin] RBAC: Authorizing `identity:get_project(project_id=4b132bd36d874539a0264f5038dd6b4b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:24.362253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3edd96-a039-4f07-bc77-522d45f76d9d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:24.363842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 562/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:24 2022] GET /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:24.369621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:24.464996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000c0d-6af4-4704-a38a-8993a14345af None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:24.497179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d285c6-e934-4734-9f04-056a4ee393f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:24.497813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d285c6-e934-4734-9f04-056a4ee393f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:24.498094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d285c6-e934-4734-9f04-056a4ee393f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:24.498369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d285c6-e934-4734-9f04-056a4ee393f3 None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b/users/429ae3d5acee4055ac4e010d5000773f/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:24.501002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d285c6-e934-4734-9f04-056a4ee393f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b132bd36d874539a0264f5038dd6b4b, user_id=429ae3d5acee4055ac4e010d5000773f, role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:24.502407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d285c6-e934-4734-9f04-056a4ee393f3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:24.516059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 561/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:43:24 2022] PUT /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b/users/429ae3d5acee4055ac4e010d5000773f/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:43:26.357124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7b5df-ab40-496e-a876-52c05886e563 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:26.357685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7b5df-ab40-496e-a876-52c05886e563 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:26.357685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7b5df-ab40-496e-a876-52c05886e563 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:26.359517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 563/1124] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:26.365160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03ddcc-fb74-4e54-bf30-cd1cb6bfb9ab None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:26.365544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03ddcc-fb74-4e54-bf30-cd1cb6bfb9ab None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:26.365709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03ddcc-fb74-4e54-bf30-cd1cb6bfb9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:26.383723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ae03ddcc-fb74-4e54-bf30-cd1cb6bfb9ab None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:26.384914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ae03ddcc-fb74-4e54-bf30-cd1cb6bfb9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:26.424052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:26.450727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 562/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:26.715182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7b5df-ab40-496e-a876-52c05886e563 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:26.718625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:26.816870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7b5df-ab40-496e-a876-52c05886e563 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:26.848884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:26.849502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:26.849783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:26.850058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] PATH_INFO: `/v3/roles/b43107f11d524f23b650a3c7272c0dc8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:26.851423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] RBAC: Authorizing `identity:get_role(role_id=b43107f11d524f23b650a3c7272c0dc8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:26.852825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:26.854103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 564/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:26 2022] GET /identity/v3/roles/b43107f11d524f23b650a3c7272c0dc8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:26.860239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03ddcc-fb74-4e54-bf30-cd1cb6bfb9ab None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:26.954547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03ddcc-fb74-4e54-bf30-cd1cb6bfb9ab None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:26.987213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:26.987820 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:26.988127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:26.988460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] PATH_INFO: `/v3/users/429ae3d5acee4055ac4e010d5000773f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:26.989623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] RBAC: Authorizing `identity:get_user(user_id=429ae3d5acee4055ac4e010d5000773f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:26.991046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:26.992780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 563/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:26 2022] GET /identity/v3/users/429ae3d5acee4055ac4e010d5000773f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:26.998306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:27.066037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:27.095339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9eb30-0aca-4a50-9e96-4642a04719fe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:27.128824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:27.129416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:27.129694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:27.129973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:27.195484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:27.196957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:27.261608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:27.293325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 565/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:27.299689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:27.340517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:27.394807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ee616-fb95-4f94-b7dc-52244ea0db0b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:27.427382 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d377f90-5183-42d2-9e59-c58bab788c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:27.427997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d377f90-5183-42d2-9e59-c58bab788c58 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:27.428281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d377f90-5183-42d2-9e59-c58bab788c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:27.428591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d377f90-5183-42d2-9e59-c58bab788c58 None admin] PATH_INFO: `/v3/projects/4b132bd36d874539a0264f5038dd6b4b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:27.429703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d377f90-5183-42d2-9e59-c58bab788c58 None admin] RBAC: Authorizing `identity:get_project(project_id=4b132bd36d874539a0264f5038dd6b4b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:27.431118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d377f90-5183-42d2-9e59-c58bab788c58 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:27.432739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 564/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:27 2022] GET /identity/v3/projects/4b132bd36d874539a0264f5038dd6b4b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:27.439211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:27.536197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b0981-5c96-4ea5-8316-129c12c4cf36 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:27.569024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394a71f-88ba-4dd1-9fef-2b147e78a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:27.569620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394a71f-88ba-4dd1-9fef-2b147e78a82e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:27.569909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394a71f-88ba-4dd1-9fef-2b147e78a82e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:27.570186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394a71f-88ba-4dd1-9fef-2b147e78a82e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:27.570909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394a71f-88ba-4dd1-9fef-2b147e78a82e None admin] RBAC: Adding query filter params (role.id=b43107f11d524f23b650a3c7272c0dc8, scope.project.id=4b132bd36d874539a0264f5038dd6b4b, user.id=429ae3d5acee4055ac4e010d5000773f) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:27.571222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394a71f-88ba-4dd1-9fef-2b147e78a82e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:27.572701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394a71f-88ba-4dd1-9fef-2b147e78a82e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:27.579422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 566/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:27 2022] GET /identity/v3/role_assignments?user.id=429ae3d5acee4055ac4e010d5000773f&scope.project.id=4b132bd36d874539a0264f5038dd6b4b&role.id=b43107f11d524f23b650a3c7272c0dc8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:29.493421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f945-27d4-46f4-b2d1-af61d586f5d2 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:29.494021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f945-27d4-46f4-b2d1-af61d586f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:29.494021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2f945-27d4-46f4-b2d1-af61d586f5d2 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:29.495294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 565/1131] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:29.500441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a765d-a47d-42f0-b130-9c9f7660993d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:29.500889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a765d-a47d-42f0-b130-9c9f7660993d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:29.500997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a765d-a47d-42f0-b130-9c9f7660993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:29.519771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-282a765d-a47d-42f0-b130-9c9f7660993d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:29.521220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-282a765d-a47d-42f0-b130-9c9f7660993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:29.552948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:29.592589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 567/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:29.870884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2f945-27d4-46f4-b2d1-af61d586f5d2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:29.972066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2f945-27d4-46f4-b2d1-af61d586f5d2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:29.982392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:30.005188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcab0d8-a9ad-44f0-9036-8489783e913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:30.005804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab0d8-a9ad-44f0-9036-8489783e913b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:30.006084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab0d8-a9ad-44f0-9036-8489783e913b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:30.006354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcab0d8-a9ad-44f0-9036-8489783e913b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:30.007446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcab0d8-a9ad-44f0-9036-8489783e913b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:30.008886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcab0d8-a9ad-44f0-9036-8489783e913b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:30.010412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 566/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:30.017108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a765d-a47d-42f0-b130-9c9f7660993d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:30.112241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a765d-a47d-42f0-b130-9c9f7660993d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:30.145844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1d628-08e5-4d20-a661-f6deafbbf09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:30.146402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d628-08e5-4d20-a661-f6deafbbf09c None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:30.146684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d628-08e5-4d20-a661-f6deafbbf09c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:30.146959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d628-08e5-4d20-a661-f6deafbbf09c None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:30.147593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1d628-08e5-4d20-a661-f6deafbbf09c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:30.149081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1d628-08e5-4d20-a661-f6deafbbf09c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:30.176922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 568/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:43:30 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:32.118650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3172-37fd-4e14-b755-06abe994ae2b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:32.119205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3172-37fd-4e14-b755-06abe994ae2b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:32.119205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3172-37fd-4e14-b755-06abe994ae2b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:32.120524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 567/1135] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:32.126366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd44d6-0157-4529-8931-17277f5c90c7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:32.126797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd44d6-0157-4529-8931-17277f5c90c7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:32.126916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd44d6-0157-4529-8931-17277f5c90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:32.144864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b8bd44d6-0157-4529-8931-17277f5c90c7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:32.146036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b8bd44d6-0157-4529-8931-17277f5c90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:32.156439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:32.212973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 569/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:32.484589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3172-37fd-4e14-b755-06abe994ae2b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:32.582749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3172-37fd-4e14-b755-06abe994ae2b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:32.615128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df856ca-1fed-4436-b03f-7d69e9f9d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:32.615747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df856ca-1fed-4436-b03f-7d69e9f9d393 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:32.616027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df856ca-1fed-4436-b03f-7d69e9f9d393 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:32.616300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df856ca-1fed-4436-b03f-7d69e9f9d393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:32.617425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df856ca-1fed-4436-b03f-7d69e9f9d393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:32.618837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df856ca-1fed-4436-b03f-7d69e9f9d393 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:32.620379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 568/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:43:32.626552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd44d6-0157-4529-8931-17277f5c90c7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:32.721691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd44d6-0157-4529-8931-17277f5c90c7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:32.754444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e3da3-8122-47c5-ae75-812a91379bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:32.754981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3da3-8122-47c5-ae75-812a91379bdd None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:32.755265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3da3-8122-47c5-ae75-812a91379bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:32.755541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e3da3-8122-47c5-ae75-812a91379bdd None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:32.756191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e3da3-8122-47c5-ae75-812a91379bdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:32.757665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e3da3-8122-47c5-ae75-812a91379bdd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:32.778899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 570/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:43:32 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:34.685003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941f99-5a3d-49d6-a26b-7c397b255552 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:34.685563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941f99-5a3d-49d6-a26b-7c397b255552 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:34.685563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d941f99-5a3d-49d6-a26b-7c397b255552 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:34.687350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 569/1139] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:34.692519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaa7e-1dc2-4cf7-a3a3-58103010bf98 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:34.692903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaa7e-1dc2-4cf7-a3a3-58103010bf98 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:34.693077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbaa7e-1dc2-4cf7-a3a3-58103010bf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:34.699329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:34.712886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f3cbaa7e-1dc2-4cf7-a3a3-58103010bf98 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:34.714070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f3cbaa7e-1dc2-4cf7-a3a3-58103010bf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:34.778907 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 571/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:35.048167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d941f99-5a3d-49d6-a26b-7c397b255552 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:35.095098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:35.146819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d941f99-5a3d-49d6-a26b-7c397b255552 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:35.179177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:35.179792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:35.180074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:35.180348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:35.190256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:35.195186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:35.196479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:35.197634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 570/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:35.202721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbaa7e-1dc2-4cf7-a3a3-58103010bf98 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:35.298161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbaa7e-1dc2-4cf7-a3a3-58103010bf98 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:35.325968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:35.331558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:35.332154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:35.332464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:35.332736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:35.333393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:35.333699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:35.335068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:35.343505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 572/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:35.349115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:35.444589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b02d6-702e-4dad-bbd8-86e2b099245b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:35.451429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:35.476985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:35.477586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:35.477864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:35.478135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] PATH_INFO: `/v3/users/82bc63b64deb4d97afc837cdf512b01e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:35.491178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] RBAC: Authorizing `identity:get_user(user_id=82bc63b64deb4d97afc837cdf512b01e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:35.492626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:35.494167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 571/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:35 2022] GET /identity/v3/users/82bc63b64deb4d97afc837cdf512b01e => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:35.499943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:35.597657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c45dc-b363-4740-9ab6-4d24e5c2e65c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:35.630373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:35.630971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:35.631252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:35.631520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:35.688962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:35.696741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:35.698191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:35.792071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 573/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:35.798006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:35.895774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d02501-54d6-408f-918c-2ff5336420d2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:35.928104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4dfece-c525-497a-b9fd-66ee73529eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:35.928762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dfece-c525-497a-b9fd-66ee73529eec None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:35.929045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dfece-c525-497a-b9fd-66ee73529eec None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:35.929318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4dfece-c525-497a-b9fd-66ee73529eec None admin] PATH_INFO: `/v3/projects/481014eb6df2487da663b5782b8b38f6` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:35.930424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dfece-c525-497a-b9fd-66ee73529eec None admin] RBAC: Authorizing `identity:get_project(project_id=481014eb6df2487da663b5782b8b38f6)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:35.931927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4dfece-c525-497a-b9fd-66ee73529eec None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:35.934642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 572/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:35 2022] GET /identity/v3/projects/481014eb6df2487da663b5782b8b38f6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:35.941336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:36.031516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:36.043390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559875c6-147c-452a-a0d9-62992192c17a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:36.081445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625e733-2585-4aee-8753-0a4edaa0ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:36.082045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625e733-2585-4aee-8753-0a4edaa0ff4e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:36.082327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625e733-2585-4aee-8753-0a4edaa0ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:36.082600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625e733-2585-4aee-8753-0a4edaa0ff4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:36.083319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625e733-2585-4aee-8753-0a4edaa0ff4e None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=481014eb6df2487da663b5782b8b38f6, user.id=82bc63b64deb4d97afc837cdf512b01e) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:36.083626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625e733-2585-4aee-8753-0a4edaa0ff4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:36.085115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625e733-2585-4aee-8753-0a4edaa0ff4e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:36.090569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 574/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:35 2022] GET /identity/v3/role_assignments?user.id=82bc63b64deb4d97afc837cdf512b01e&scope.project.id=481014eb6df2487da663b5782b8b38f6&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:37.980735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442696-b18e-4c5d-8450-3fdda3fc9ff5 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:37.981293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442696-b18e-4c5d-8450-3fdda3fc9ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:37.981293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e442696-b18e-4c5d-8450-3fdda3fc9ff5 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:37.982629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 573/1147] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:37.988479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4758f-282b-45e7-b8bb-ba73e457bdd0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:37.988915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4758f-282b-45e7-b8bb-ba73e457bdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:37.989023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4758f-282b-45e7-b8bb-ba73e457bdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:38.006633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dba4758f-282b-45e7-b8bb-ba73e457bdd0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:38.007817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dba4758f-282b-45e7-b8bb-ba73e457bdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:38.073134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 575/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:38.342671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e442696-b18e-4c5d-8450-3fdda3fc9ff5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:38.372866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:38.442680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e442696-b18e-4c5d-8450-3fdda3fc9ff5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:38.475362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:38.475973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:38.476312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:38.476618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:38.486956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:38.491598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:38.492716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:38.493729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 574/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:38.498727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4758f-282b-45e7-b8bb-ba73e457bdd0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:38.583333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:38.595631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4758f-282b-45e7-b8bb-ba73e457bdd0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:38.628805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:38.629408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:38.629688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:38.629960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:38.630621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:38.630924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:38.632298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:38.640948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 576/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:38.646755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:38.734128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:38.742688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1252fa8-ad55-4a60-a91a-7079227ba586 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:38.775329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:38.775942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:38.776225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:38.776529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] PATH_INFO: `/v3/users/82bc63b64deb4d97afc837cdf512b01e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:38.777639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] RBAC: Authorizing `identity:get_user(user_id=82bc63b64deb4d97afc837cdf512b01e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:38.779049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:38.781219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 575/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:38 2022] GET /identity/v3/users/82bc63b64deb4d97afc837cdf512b01e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:38.786895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:38.883082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e8ed2-0ef4-4305-a315-106aa821fc5f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:38.915101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf9eb-4166-48d6-8923-46f625390d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:38.915706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf9eb-4166-48d6-8923-46f625390d37 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:38.915981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf9eb-4166-48d6-8923-46f625390d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:38.916246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf9eb-4166-48d6-8923-46f625390d37 None admin] PATH_INFO: `/v3/projects/481014eb6df2487da663b5782b8b38f6` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:38.917354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf9eb-4166-48d6-8923-46f625390d37 None admin] RBAC: Authorizing `identity:get_project(project_id=481014eb6df2487da663b5782b8b38f6)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:38.918767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf9eb-4166-48d6-8923-46f625390d37 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:38.920324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 577/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:38 2022] GET /identity/v3/projects/481014eb6df2487da663b5782b8b38f6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:38.926610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:39.023761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c464c1-c24d-467e-b7dc-86e3d7e49c68 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:39.056614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df9e4-d6af-4ba7-810b-0c53744d70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:39.057261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df9e4-d6af-4ba7-810b-0c53744d70dd None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:39.057546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df9e4-d6af-4ba7-810b-0c53744d70dd None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:39.057827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df9e4-d6af-4ba7-810b-0c53744d70dd None admin] PATH_INFO: `/v3/projects/481014eb6df2487da663b5782b8b38f6/users/82bc63b64deb4d97afc837cdf512b01e/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:39.059731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df9e4-d6af-4ba7-810b-0c53744d70dd None admin] RBAC: Authorizing `identity:create_grant(project_id=481014eb6df2487da663b5782b8b38f6, user_id=82bc63b64deb4d97afc837cdf512b01e, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:39.061194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df9e4-d6af-4ba7-810b-0c53744d70dd None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:39.073700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 576/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:43:38 2022] PUT /identity/v3/projects/481014eb6df2487da663b5782b8b38f6/users/82bc63b64deb4d97afc837cdf512b01e/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:43:40.957892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f109-e5d3-4d78-9cce-dfa77d3d6d78 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:40.958427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f109-e5d3-4d78-9cce-dfa77d3d6d78 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:40.958427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f109-e5d3-4d78-9cce-dfa77d3d6d78 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:40.959767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 578/1154] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:40.965607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5380-6472-43c6-a46f-9f91d3c08f5f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:40.966014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5380-6472-43c6-a46f-9f91d3c08f5f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:40.966179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d5380-6472-43c6-a46f-9f91d3c08f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:40.984317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-175d5380-6472-43c6-a46f-9f91d3c08f5f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:40.985537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-175d5380-6472-43c6-a46f-9f91d3c08f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:40.999577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:41.051283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 577/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:41.315559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f109-e5d3-4d78-9cce-dfa77d3d6d78 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:41.334447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:41.413838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f109-e5d3-4d78-9cce-dfa77d3d6d78 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:41.446366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:41.446973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:41.447254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:41.447526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:41.457686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:41.462292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:41.463365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:41.464728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 579/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:41.469846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5380-6472-43c6-a46f-9f91d3c08f5f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:41.564871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d5380-6472-43c6-a46f-9f91d3c08f5f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:41.597965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:41.598566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:41.598849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:41.599124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:41.599789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:41.600093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:41.601478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:41.609401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 578/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:41.615127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:41.691255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:41.712294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3573202-6c3a-4791-875e-9d65fea47855 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:41.745298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:41.745914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:41.746196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:41.746470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] PATH_INFO: `/v3/users/82bc63b64deb4d97afc837cdf512b01e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:41.747572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=82bc63b64deb4d97afc837cdf512b01e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:41.749069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:41.750604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 580/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:41 2022] GET /identity/v3/users/82bc63b64deb4d97afc837cdf512b01e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:41.756314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:41.771365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:41.853629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b6771-83d9-429a-b7f9-2aa13640e90c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:41.885263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:41.885862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:41.886145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:41.886419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:41.952988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:41.954430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:41.967641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:42.051730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 579/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:42.057723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:42.162554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba020b1-fb12-4999-8002-f6cbe750f7a7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:42.195212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66154232-fe5d-4d40-8190-c7ae536e79e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:42.195839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66154232-fe5d-4d40-8190-c7ae536e79e6 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:42.196123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66154232-fe5d-4d40-8190-c7ae536e79e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:42.196425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66154232-fe5d-4d40-8190-c7ae536e79e6 None admin] PATH_INFO: `/v3/projects/481014eb6df2487da663b5782b8b38f6` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:42.197538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66154232-fe5d-4d40-8190-c7ae536e79e6 None admin] RBAC: Authorizing `identity:get_project(project_id=481014eb6df2487da663b5782b8b38f6)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:42.198980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66154232-fe5d-4d40-8190-c7ae536e79e6 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:42.200617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 581/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:42 2022] GET /identity/v3/projects/481014eb6df2487da663b5782b8b38f6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:42.207331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:42.304508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134918-51a2-4ae0-a0b7-e916c377a70b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:42.317462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:42.338006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496a879-ba09-450f-ba50-b5925fb72151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:42.338601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a879-ba09-450f-ba50-b5925fb72151 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:42.338884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a879-ba09-450f-ba50-b5925fb72151 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:42.339156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496a879-ba09-450f-ba50-b5925fb72151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:42.339882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496a879-ba09-450f-ba50-b5925fb72151 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=481014eb6df2487da663b5782b8b38f6, user.id=82bc63b64deb4d97afc837cdf512b01e) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:42.340193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496a879-ba09-450f-ba50-b5925fb72151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:42.341652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496a879-ba09-450f-ba50-b5925fb72151 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:42.347749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 580/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:42 2022] GET /identity/v3/role_assignments?user.id=82bc63b64deb4d97afc837cdf512b01e&scope.project.id=481014eb6df2487da663b5782b8b38f6&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:44.262914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f550-0d5e-4eb0-ae56-c485386b8549 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:44.263772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f550-0d5e-4eb0-ae56-c485386b8549 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:44.263772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76f550-0d5e-4eb0-ae56-c485386b8549 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:44.265220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 582/1162] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:44.270461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bf00-4a5a-4f23-b4bd-57ed693c09dc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:44.270882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bf00-4a5a-4f23-b4bd-57ed693c09dc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:44.271003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bf00-4a5a-4f23-b4bd-57ed693c09dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:44.288760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7d81bf00-4a5a-4f23-b4bd-57ed693c09dc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:44.289947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7d81bf00-4a5a-4f23-b4bd-57ed693c09dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:44.360627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 581/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:44.628755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f550-0d5e-4eb0-ae56-c485386b8549 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:44.644906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:44.730630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76f550-0d5e-4eb0-ae56-c485386b8549 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:44.763108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:44.763973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:44.764914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:44.765162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:44.828069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:44.829471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:44.842821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:44.925500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 583/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:44.931424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bf00-4a5a-4f23-b4bd-57ed693c09dc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:45.031091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bf00-4a5a-4f23-b4bd-57ed693c09dc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:45.039837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:45.069819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5791f3d-6e23-4312-9219-0f5f5907443e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:45.070445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5791f3d-6e23-4312-9219-0f5f5907443e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:45.070732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5791f3d-6e23-4312-9219-0f5f5907443e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:45.071008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5791f3d-6e23-4312-9219-0f5f5907443e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:45.077454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5791f3d-6e23-4312-9219-0f5f5907443e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:45.078931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5791f3d-6e23-4312-9219-0f5f5907443e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-c5791f3d-6e23-4312-9219-0f5f5907443e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:45.089868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:45.091040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:43:45.091905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 582/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:43:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:45.097249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:45.193985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9eabe7-5bb6-41a8-868d-0d23f065686d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:45.207646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:45.227487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a20968-9822-4275-a94b-1e3190ee5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:45.228088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a20968-9822-4275-a94b-1e3190ee5e83 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:45.228366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a20968-9822-4275-a94b-1e3190ee5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:45.228667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a20968-9822-4275-a94b-1e3190ee5e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:45.229304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a20968-9822-4275-a94b-1e3190ee5e83 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:45.229607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a20968-9822-4275-a94b-1e3190ee5e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:45.230983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a20968-9822-4275-a94b-1e3190ee5e83 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:45.238535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 584/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Wed Aug 24 08:43:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:47.126012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2fa69-a7d3-4220-a626-b266c2c35209 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:47.126539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2fa69-a7d3-4220-a626-b266c2c35209 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:47.126539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2fa69-a7d3-4220-a626-b266c2c35209 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:47.127890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 583/1167] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:47.133051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65baa9-add6-4159-bafb-5746a6dbc6dd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:47.133488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65baa9-add6-4159-bafb-5746a6dbc6dd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:47.133581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65baa9-add6-4159-bafb-5746a6dbc6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:47.151778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dd65baa9-add6-4159-bafb-5746a6dbc6dd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:47.152987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dd65baa9-add6-4159-bafb-5746a6dbc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:47.216855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 585/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:47.490798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2fa69-a7d3-4220-a626-b266c2c35209 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:47.592951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2fa69-a7d3-4220-a626-b266c2c35209 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:47.625218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d5a31-ebc6-46b8-93b7-8ee458213586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:47.625816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d5a31-ebc6-46b8-93b7-8ee458213586 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:47.626098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d5a31-ebc6-46b8-93b7-8ee458213586 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:47.626373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d5a31-ebc6-46b8-93b7-8ee458213586 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:47.627034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d5a31-ebc6-46b8-93b7-8ee458213586 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:47.628412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d5a31-ebc6-46b8-93b7-8ee458213586 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:47.645493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 584/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Wed Aug 24 08:43:47 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:49.559108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f8e2-94da-45b2-913b-efc4c6dea7b6 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:49.559636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f8e2-94da-45b2-913b-efc4c6dea7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:49.559636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8f8e2-94da-45b2-913b-efc4c6dea7b6 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:49.561095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 586/1170] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:49.566254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9e5b-170f-4e10-b0b7-a11caab98556 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:49.566625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9e5b-170f-4e10-b0b7-a11caab98556 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:49.566812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af9e5b-170f-4e10-b0b7-a11caab98556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:49.585238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e0af9e5b-170f-4e10-b0b7-a11caab98556 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:49.586435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e0af9e5b-170f-4e10-b0b7-a11caab98556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:49.606473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:49.653482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 585/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:49.926821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f8e2-94da-45b2-913b-efc4c6dea7b6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:50.025173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8f8e2-94da-45b2-913b-efc4c6dea7b6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:50.033924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:50.057734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb336fe8-7e51-4af1-952c-dab23fd50e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:50.058347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb336fe8-7e51-4af1-952c-dab23fd50e97 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:50.058629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb336fe8-7e51-4af1-952c-dab23fd50e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:50.058899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb336fe8-7e51-4af1-952c-dab23fd50e97 None admin] PATH_INFO: `/v3/domains/21524eb82fe542f4968a1e10d5d93060` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:50.069383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb336fe8-7e51-4af1-952c-dab23fd50e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=21524eb82fe542f4968a1e10d5d93060)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:50.070826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb336fe8-7e51-4af1-952c-dab23fd50e97 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:50.072360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 587/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Aug 24 08:43:49 2022] GET /identity/v3/domains/21524eb82fe542f4968a1e10d5d93060 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:50.078841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af9e5b-170f-4e10-b0b7-a11caab98556 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:50.174173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af9e5b-170f-4e10-b0b7-a11caab98556 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:50.207323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a7d1f-ff88-4b6a-a0d0-b58ca2c5ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:50.207862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7d1f-ff88-4b6a-a0d0-b58ca2c5ea5a None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:50.208144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7d1f-ff88-4b6a-a0d0-b58ca2c5ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:50.208442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7d1f-ff88-4b6a-a0d0-b58ca2c5ea5a None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:50.209084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a7d1f-ff88-4b6a-a0d0-b58ca2c5ea5a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:50.210504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a7d1f-ff88-4b6a-a0d0-b58ca2c5ea5a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:50.236686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 586/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:43:50 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:52.132243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e285d-ca59-46a7-a6eb-b519c902433f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:52.132813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e285d-ca59-46a7-a6eb-b519c902433f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:52.132813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e285d-ca59-46a7-a6eb-b519c902433f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:52.134173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 588/1174] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:52.139580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbabd1-2714-4eab-b2f6-7136afca6ff9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:52.139996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbabd1-2714-4eab-b2f6-7136afca6ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:52.140124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbabd1-2714-4eab-b2f6-7136afca6ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:52.158571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9ecbabd1-2714-4eab-b2f6-7136afca6ff9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:52.159751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9ecbabd1-2714-4eab-b2f6-7136afca6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:52.161684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:52.225504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 587/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:52.504200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e285d-ca59-46a7-a6eb-b519c902433f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:52.604368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e285d-ca59-46a7-a6eb-b519c902433f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:52.637221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9943b7-0322-480e-8b39-6d4050e661cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:52.637836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9943b7-0322-480e-8b39-6d4050e661cf None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:52.638382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9943b7-0322-480e-8b39-6d4050e661cf None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:52.638656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9943b7-0322-480e-8b39-6d4050e661cf None admin] PATH_INFO: `/v3/domains/21524eb82fe542f4968a1e10d5d93060` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:52.639789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9943b7-0322-480e-8b39-6d4050e661cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=21524eb82fe542f4968a1e10d5d93060)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:52.641283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9943b7-0322-480e-8b39-6d4050e661cf None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:52.642823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 589/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Wed Aug 24 08:43:52 2022] GET /identity/v3/domains/21524eb82fe542f4968a1e10d5d93060 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:52.648594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbabd1-2714-4eab-b2f6-7136afca6ff9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:52.742686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbabd1-2714-4eab-b2f6-7136afca6ff9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:52.774814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d26d3-fb81-4532-9a6e-b8a286d72647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:52.775351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d26d3-fb81-4532-9a6e-b8a286d72647 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:52.775628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d26d3-fb81-4532-9a6e-b8a286d72647 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:52.775897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d26d3-fb81-4532-9a6e-b8a286d72647 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:52.776567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d26d3-fb81-4532-9a6e-b8a286d72647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:52.777969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d26d3-fb81-4532-9a6e-b8a286d72647 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:52.787957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:52.800595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 588/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:43:52 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:43:54.758094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844320-4c77-41a9-8e58-f43b8309466d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:54.758634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844320-4c77-41a9-8e58-f43b8309466d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:54.758634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844320-4c77-41a9-8e58-f43b8309466d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:54.759980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 590/1178] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:54.766053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557697-7be1-42a5-9943-65bcd4ac6583 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:54.766467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557697-7be1-42a5-9943-65bcd4ac6583 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:54.766608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22557697-7be1-42a5-9943-65bcd4ac6583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:54.784623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-22557697-7be1-42a5-9943-65bcd4ac6583 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:54.785840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22557697-7be1-42a5-9943-65bcd4ac6583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:54.848999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 589/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:55.118809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51844320-4c77-41a9-8e58-f43b8309466d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:55.154788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:55.218243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51844320-4c77-41a9-8e58-f43b8309466d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:55.250293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:55.250905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:55.251187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:55.251457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:55.261440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:55.266286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:55.267539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:55.268876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 591/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:55.273248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22557697-7be1-42a5-9943-65bcd4ac6583 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:55.367707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22557697-7be1-42a5-9943-65bcd4ac6583 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:55.391610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:55.403451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:55.404057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:55.404338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:55.404645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:55.405310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:55.405615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:55.406980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:55.415005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 590/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:55.421377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:55.513636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:55.519623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297e586-4792-4573-87be-a9d436c2ddd9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:55.551862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:55.552602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:55.552894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:55.553169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] PATH_INFO: `/v3/users/52b491b6997a4c8ca588802571a3f54c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:55.566591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] RBAC: Authorizing `identity:get_user(user_id=52b491b6997a4c8ca588802571a3f54c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:55.568114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:55.569721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 592/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:55 2022] GET /identity/v3/users/52b491b6997a4c8ca588802571a3f54c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:55.575723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:55.680086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a3677-1b2a-4d71-b7c5-ff7d91fe2611 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:55.713132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:55.713726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:55.714010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:55.714285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:55.766962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:55.780708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:55.782137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:55.876779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 591/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:43:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:43:55.882675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:55.978580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855d8a1-e954-4f57-977b-40a8c386acc2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:56.011339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c9c81-6580-434f-8c2f-7c5c514c38f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:56.011961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9c81-6580-434f-8c2f-7c5c514c38f5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:56.012244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9c81-6580-434f-8c2f-7c5c514c38f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:56.012558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c9c81-6580-434f-8c2f-7c5c514c38f5 None admin] PATH_INFO: `/v3/projects/82123435dc144a609a1f47487b5d216f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:56.013923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9c81-6580-434f-8c2f-7c5c514c38f5 None admin] RBAC: Authorizing `identity:get_project(project_id=82123435dc144a609a1f47487b5d216f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:56.015355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c9c81-6580-434f-8c2f-7c5c514c38f5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:56.016992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 593/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:55 2022] GET /identity/v3/projects/82123435dc144a609a1f47487b5d216f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:56.023001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:56.103898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:56.118653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0a54-fb3a-47cc-9d93-6ee150f34c42 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:56.151469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b9dd8-bfd4-4fed-a288-f402577727b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:56.152067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9dd8-bfd4-4fed-a288-f402577727b5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:56.152349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9dd8-bfd4-4fed-a288-f402577727b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:56.152720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b9dd8-bfd4-4fed-a288-f402577727b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:56.153448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9dd8-bfd4-4fed-a288-f402577727b5 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=82123435dc144a609a1f47487b5d216f, user.id=52b491b6997a4c8ca588802571a3f54c) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:56.153758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9dd8-bfd4-4fed-a288-f402577727b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:56.155171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b9dd8-bfd4-4fed-a288-f402577727b5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:56.160536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 592/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:43:56 2022] GET /identity/v3/role_assignments?user.id=52b491b6997a4c8ca588802571a3f54c&scope.project.id=82123435dc144a609a1f47487b5d216f&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:58.001697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162137d-75b2-4acf-b4e1-ef797538f52a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:58.002237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162137d-75b2-4acf-b4e1-ef797538f52a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:58.002237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162137d-75b2-4acf-b4e1-ef797538f52a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:58.003582 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 594/1186] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:43:58.008716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5b56-938b-4349-81e7-71412fc03ce0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:58.009117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5b56-938b-4349-81e7-71412fc03ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:58.009260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d5b56-938b-4349-81e7-71412fc03ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:58.027566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f46d5b56-938b-4349-81e7-71412fc03ce0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:43:58.028774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f46d5b56-938b-4349-81e7-71412fc03ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:43:58.092520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 593/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:43:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:43:58.360373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162137d-75b2-4acf-b4e1-ef797538f52a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:58.384171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:58.462107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162137d-75b2-4acf-b4e1-ef797538f52a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:58.501769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:58.502393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:58.502675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:58.502953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:58.512779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:43:58.517741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:43:58.518823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:43:58.520002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 595/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:43:58.524885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5b56-938b-4349-81e7-71412fc03ce0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:58.603682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:58.624603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d5b56-938b-4349-81e7-71412fc03ce0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:58.656842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:58.657442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:58.657726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:58.658006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:58.658671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:43:58.658977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:58.660338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:58.668058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 594/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:58.674345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:58.754983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:43:58.775577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12edc77-01d5-4524-8fe4-93d06785f53d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:58.809378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:58.810011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:58.810833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:58.811112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] PATH_INFO: `/v3/users/52b491b6997a4c8ca588802571a3f54c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:58.812240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] RBAC: Authorizing `identity:get_user(user_id=52b491b6997a4c8ca588802571a3f54c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:58.813718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:58.815302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 596/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:43:58 2022] GET /identity/v3/users/52b491b6997a4c8ca588802571a3f54c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:58.821073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:58.917718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae9f8c-cb79-498e-8fd3-a1c4427861e5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:58.949710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487d80e-16fb-4170-99ab-678f116dd6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:58.950322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d80e-16fb-4170-99ab-678f116dd6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:58.950603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d80e-16fb-4170-99ab-678f116dd6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:58.950876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487d80e-16fb-4170-99ab-678f116dd6f5 None admin] PATH_INFO: `/v3/projects/82123435dc144a609a1f47487b5d216f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:58.952730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d80e-16fb-4170-99ab-678f116dd6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=82123435dc144a609a1f47487b5d216f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:58.954139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487d80e-16fb-4170-99ab-678f116dd6f5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:58.955731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 595/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:43:58 2022] GET /identity/v3/projects/82123435dc144a609a1f47487b5d216f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:43:58.961546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:43:59.057418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c836023-e0dc-4297-8cb3-e659cfbe914c None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:43:59.090614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344415e3-3e8c-4b31-a20b-33d38cbc9f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:43:59.091254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344415e3-3e8c-4b31-a20b-33d38cbc9f2d None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:43:59.091597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344415e3-3e8c-4b31-a20b-33d38cbc9f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:43:59.091870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344415e3-3e8c-4b31-a20b-33d38cbc9f2d None admin] PATH_INFO: `/v3/projects/82123435dc144a609a1f47487b5d216f/users/52b491b6997a4c8ca588802571a3f54c/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:43:59.093785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344415e3-3e8c-4b31-a20b-33d38cbc9f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=82123435dc144a609a1f47487b5d216f, user_id=52b491b6997a4c8ca588802571a3f54c, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:43:59.095211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344415e3-3e8c-4b31-a20b-33d38cbc9f2d None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:43:59.108757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 597/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:43:58 2022] PUT /identity/v3/projects/82123435dc144a609a1f47487b5d216f/users/52b491b6997a4c8ca588802571a3f54c/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:44:00.993218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366c47-0b87-47b3-85d9-24aae3310fec None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:00.993764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366c47-0b87-47b3-85d9-24aae3310fec None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:00.993764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93366c47-0b87-47b3-85d9-24aae3310fec None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:00.995089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 596/1193] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:44:01.000881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4bca-12bb-46ea-863d-e9da7f976715 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:01.001294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4bca-12bb-46ea-863d-e9da7f976715 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:01.001434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4bca-12bb-46ea-863d-e9da7f976715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:01.020485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d7fe4bca-12bb-46ea-863d-e9da7f976715 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:44:01.021694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d7fe4bca-12bb-46ea-863d-e9da7f976715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:44:01.024365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:01.086359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 598/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:44:01.358641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366c47-0b87-47b3-85d9-24aae3310fec None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:01.371196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:01.457081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93366c47-0b87-47b3-85d9-24aae3310fec None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:01.489514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:01.490131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:01.490411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:01.490685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:01.500408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:44:01.505206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:44:01.506311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:44:01.507530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 597/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:44:01.512329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe4bca-12bb-46ea-863d-e9da7f976715 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:01.612570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe4bca-12bb-46ea-863d-e9da7f976715 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:01.644850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:01.645446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:01.645725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:01.645994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:01.646650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:44:01.646951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:01.648315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:01.656699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 599/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:44:01.662611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:01.729955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:01.760629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060d6e9-cdb2-472d-8ec2-45a1c5c5cbe3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:01.793543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:01.794160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:01.794443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:01.794720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] PATH_INFO: `/v3/users/52b491b6997a4c8ca588802571a3f54c` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:01.795831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] RBAC: Authorizing `identity:get_user(user_id=52b491b6997a4c8ca588802571a3f54c)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:01.797284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:01.798835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 598/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Wed Aug 24 08:44:01 2022] GET /identity/v3/users/52b491b6997a4c8ca588802571a3f54c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:44:01.804709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:01.807517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:01.903616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19964e9a-0041-4d4e-9647-c632d885f397 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:01.936489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:01.937089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:01.937366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:01.937636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:02.002439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:02.003886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:02.005649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:02.098921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 600/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:44:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:44:02.104882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:02.200219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953eb2f-6b13-459e-9c45-871d7f51b3fe None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:02.233808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34668fdc-31cb-4030-b059-3b92d9695138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:02.234440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668fdc-31cb-4030-b059-3b92d9695138 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:02.234720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668fdc-31cb-4030-b059-3b92d9695138 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:02.234993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34668fdc-31cb-4030-b059-3b92d9695138 None admin] PATH_INFO: `/v3/projects/82123435dc144a609a1f47487b5d216f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:02.236099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34668fdc-31cb-4030-b059-3b92d9695138 None admin] RBAC: Authorizing `identity:get_project(project_id=82123435dc144a609a1f47487b5d216f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:02.237553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34668fdc-31cb-4030-b059-3b92d9695138 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:02.239251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 599/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Wed Aug 24 08:44:02 2022] GET /identity/v3/projects/82123435dc144a609a1f47487b5d216f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:44:02.245388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:02.340637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a310cc-2fc6-4fc7-85ca-06bec6773317 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:02.342759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:02.375400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7915b74-8187-419e-b054-f4a009b5ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:02.376000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7915b74-8187-419e-b054-f4a009b5ab7a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:02.376281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7915b74-8187-419e-b054-f4a009b5ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:02.376583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7915b74-8187-419e-b054-f4a009b5ab7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:02.377305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7915b74-8187-419e-b054-f4a009b5ab7a None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=82123435dc144a609a1f47487b5d216f, user.id=52b491b6997a4c8ca588802571a3f54c) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:44:02.377614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7915b74-8187-419e-b054-f4a009b5ab7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:02.379044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7915b74-8187-419e-b054-f4a009b5ab7a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:02.384675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 601/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:44:02 2022] GET /identity/v3/role_assignments?user.id=52b491b6997a4c8ca588802571a3f54c&scope.project.id=82123435dc144a609a1f47487b5d216f&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:44:12.229516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:12.382523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=17 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:57.487041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9dbda-42a8-450d-9049-9b514bc7ea6d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:57.487041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9dbda-42a8-450d-9049-9b514bc7ea6d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:57.487041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9dbda-42a8-450d-9049-9b514bc7ea6d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:57.488316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 600/1201] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:44:57.494058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e5de-e7e8-4780-a5b2-491f0cb89258 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:57.495177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e5de-e7e8-4780-a5b2-491f0cb89258 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:57.495177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e5de-e7e8-4780-a5b2-491f0cb89258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:57.518154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c162e5de-e7e8-4780-a5b2-491f0cb89258 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:44:57.519398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c162e5de-e7e8-4780-a5b2-491f0cb89258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:44:57.616676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 602/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:44:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:44:57.882234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9dbda-42a8-450d-9049-9b514bc7ea6d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:57.998375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9dbda-42a8-450d-9049-9b514bc7ea6d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:58.044804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:58.045575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:58.045863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:58.046142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:58.058397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:58.060104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:44:58.076653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:44:58.077813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:44:58.079092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:44:58.079092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:44:58.079092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:44:58.082836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 601/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:44:58.083845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e5de-e7e8-4780-a5b2-491f0cb89258 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:58.214849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162e5de-e7e8-4780-a5b2-491f0cb89258 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:58.251355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:58.259325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07eb36-b31b-4e50-87e9-2419101cb00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:58.259944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07eb36-b31b-4e50-87e9-2419101cb00e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:58.260258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07eb36-b31b-4e50-87e9-2419101cb00e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:58.260584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07eb36-b31b-4e50-87e9-2419101cb00e None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:58.261272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07eb36-b31b-4e50-87e9-2419101cb00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:44:58.261537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07eb36-b31b-4e50-87e9-2419101cb00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:58.263175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07eb36-b31b-4e50-87e9-2419101cb00e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:58.276895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 603/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:44:58.283868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:44:58.345816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:44:58.413839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99c54d-82e6-4fc1-8f07-b6b56a7cc59e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:44:58.458704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a5b5a-acc1-49b7-980d-647fa6f2551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:44:58.459354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5b5a-acc1-49b7-980d-647fa6f2551c None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:44:58.459605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5b5a-acc1-49b7-980d-647fa6f2551c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:44:58.459937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a5b5a-acc1-49b7-980d-647fa6f2551c None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:44:58.460588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a5b5a-acc1-49b7-980d-647fa6f2551c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:44:58.462057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a5b5a-acc1-49b7-980d-647fa6f2551c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:44:58.489071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 602/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Wed Aug 24 08:44:58 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:45:00.566081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e281-d3d0-4b18-ac6e-e99a1d157628 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:00.566642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e281-d3d0-4b18-ac6e-e99a1d157628 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:00.566642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e281-d3d0-4b18-ac6e-e99a1d157628 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:00.568015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 604/1206] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:00.575065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1aab2-3528-486c-be88-5a966cc33052 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:00.575524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1aab2-3528-486c-be88-5a966cc33052 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:00.575853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1aab2-3528-486c-be88-5a966cc33052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:00.598494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-55f1aab2-3528-486c-be88-5a966cc33052 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:00.599791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-55f1aab2-3528-486c-be88-5a966cc33052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:00.673028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 603/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:00.957389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e281-d3d0-4b18-ac6e-e99a1d157628 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:01.084301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e281-d3d0-4b18-ac6e-e99a1d157628 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:01.135824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:01.136527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:01.137056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:01.137536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:01.149933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:45:01.155432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:01.157847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:01.159646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 605/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:01.163324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1aab2-3528-486c-be88-5a966cc33052 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:01.214922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:01.280041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1aab2-3528-486c-be88-5a966cc33052 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:01.318010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:01.318726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:01.319028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:01.319291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:01.320048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:01.320574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:01.322272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:01.336076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 604/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:01.337496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:01.397315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:01.454206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56623c7-7edc-4117-b5e1-93efb3c85e4d None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:01.492857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:01.493373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:01.493656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:01.493926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:01.506155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:01.507598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:01.524684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:01.525865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:01.531867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:01.531867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:01.531867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:01.531867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 606/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:01.532905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:01.642234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:01.645224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a61169-c137-4ba2-af96-7d5592826ef4 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:01.679942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:01.680589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:01.680891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:01.681155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:01.681815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:01.682185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:01.683941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:01.699203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 605/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:45:01.705786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:01.824654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716ef4-4e9e-4d34-8971-fe8cdfe3be6f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:01.826459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:01.862561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:01.863206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:01.863474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:01.863754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:01.872554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:01.874229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:45:01.887927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:01.889403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:01.890394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 607/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:01.895138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:02.022876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef2085-f053-4ee3-9bab-44c9aae64e28 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:02.064971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:02.065704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:02.066031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:02.066346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:02.067167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:02.067565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:02.069207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:02.090647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 606/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 08:45:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:02.096760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:02.232801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b15b9-ee02-495e-a192-bc1b9b81d5c5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:02.275658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:02.276774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:02.277301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:02.277919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:02.315395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:02.363231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:02.364734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:02.491453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 608/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:45:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:45:02.498240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:02.521331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:02.641072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1c6b0-9381-468b-ab92-0222235e10f3 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:02.680704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:02.681436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:02.681669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:02.682030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:02.695068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:02.696643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:02.713744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:02.714711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:02.715614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:02.715614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:02.715614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:02.715614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 607/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:02.720238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:02.794879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:02.841116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6c984-7086-474a-8ee9-34ea3bc52645 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:02.877618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:02.878229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:02.878506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:02.878773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:02.879411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:02.879710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:02.881112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:02.897800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 609/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:02.899351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:02.991249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:03.034817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8672c4-f897-4853-b365-3627295c61ca None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:03.075543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:03.076357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:03.076689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:03.076959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:03.086539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:03.088943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:45:03.104670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:03.106008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:03.106918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 608/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:03.113404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:03.225279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9281ee-d326-42d0-872f-67ceb01224e4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:03.248243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:03.266268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0bc63-93e1-4101-babe-bf414a123ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:03.266886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0bc63-93e1-4101-babe-bf414a123ccd None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:03.267168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0bc63-93e1-4101-babe-bf414a123ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:03.267439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0bc63-93e1-4101-babe-bf414a123ccd None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:03.268440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0bc63-93e1-4101-babe-bf414a123ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:03.268440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0bc63-93e1-4101-babe-bf414a123ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:03.269908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0bc63-93e1-4101-babe-bf414a123ccd None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:03.289053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 610/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:03.293449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:03.438395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a33fc-70db-4345-a5d9-a72afaaaa3c0 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:03.473486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:03.482992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ba81b-b63d-489c-b922-743f7fdbfa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:03.483897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ba81b-b63d-489c-b922-743f7fdbfa1e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:03.484176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ba81b-b63d-489c-b922-743f7fdbfa1e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:03.484513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ba81b-b63d-489c-b922-743f7fdbfa1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:03.485376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ba81b-b63d-489c-b922-743f7fdbfa1e None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=28ecb57b15c24e4488eb3c78413194f3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:03.485879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ba81b-b63d-489c-b922-743f7fdbfa1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:03.487505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ba81b-b63d-489c-b922-743f7fdbfa1e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:03.493545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 609/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:45:03 2022] GET /identity/v3/role_assignments?user.id=28ecb57b15c24e4488eb3c78413194f3&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:05.625245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cb55a-99af-4f3c-b5f6-afe74fe1db20 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:05.625784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cb55a-99af-4f3c-b5f6-afe74fe1db20 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:05.625938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cb55a-99af-4f3c-b5f6-afe74fe1db20 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:05.627467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 611/1220] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:05.633793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17365411-4f54-48d1-8837-3690c4905cbc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:05.634219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17365411-4f54-48d1-8837-3690c4905cbc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:05.634351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17365411-4f54-48d1-8837-3690c4905cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:05.654456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-17365411-4f54-48d1-8837-3690c4905cbc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:05.655751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-17365411-4f54-48d1-8837-3690c4905cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:05.728358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 610/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:06.038075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cb55a-99af-4f3c-b5f6-afe74fe1db20 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:06.148711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cb55a-99af-4f3c-b5f6-afe74fe1db20 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:06.185385 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:06.186108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:06.186386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:06.186704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:06.197899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:45:06.202876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:06.204050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:06.205168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 612/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:45:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:06.210637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17365411-4f54-48d1-8837-3690c4905cbc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:06.325604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17365411-4f54-48d1-8837-3690c4905cbc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:06.350454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:06.363611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:06.364240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:06.364593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:06.364896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:06.365627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] RBAC: Adding query filter params (name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:06.365910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:06.367368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:06.381243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 611/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:45:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:06.382589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:06.432344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:06.494101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a9194-9d16-48db-8714-07eb42d19a56 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:06.535883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:06.536560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:06.536840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:06.537112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:06.548213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:06.549695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:06.564751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:06.566004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:06.567270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:06.567270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:06.567270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:06.567270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 613/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:06.572055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:06.679254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b9854-dbea-489c-8827-195bd374e69c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:06.714002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:06.714610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:06.714894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:06.715171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:06.715820 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:06.716126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:06.717521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:06.730249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 612/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:06.735937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:06.837111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:06.845912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fdcd1-0014-4a8f-b88f-7a642a79bbe2 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:06.884112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:06.885402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:06.885770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:06.886041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:06.894305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:06.895867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:45:06.907666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:06.908848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:06.909998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 614/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:06.916660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:06.968562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:07.030385 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86a3a3-5a01-4ad4-81ca-d634efec3c16 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:07.068125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:07.068884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:07.069188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:07.069442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:07.070384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:07.070762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:07.072553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:07.099408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 613/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 08:45:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:07.107304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:07.223475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b00b3-6c65-49f6-8e59-77ebfde3c2e4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:07.259957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:07.260610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:07.262610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:07.262610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:07.272477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:07.274099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:07.290030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:07.291822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:07.292939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:07.292939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:07.292939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:07.292939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 615/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:07.297744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:07.405287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddabc35-9970-4a63-a4da-3c5a7f2d6a6a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:07.407763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:07.443581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:07.444306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:07.444623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:07.444893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:07.445535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:07.445834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:07.447688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:07.460184 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 614/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:45:07.466130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:07.476279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:07.578059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd1bb-5ebd-4195-b123-dc555d6ce02e None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:07.620148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:07.620870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:07.621132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:07.621442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:07.628647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:07.630229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:45:07.642673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:07.643782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:07.645154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 616/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:45:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:07.649802 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:07.772992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc6096-26cb-4248-b0f8-3d2f711fe751 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:07.811161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68527f55-e44c-41e1-b44c-a562a06746c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:07.812053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527f55-e44c-41e1-b44c-a562a06746c8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:07.812332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527f55-e44c-41e1-b44c-a562a06746c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:07.812680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68527f55-e44c-41e1-b44c-a562a06746c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:07.813479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68527f55-e44c-41e1-b44c-a562a06746c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:07.813813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68527f55-e44c-41e1-b44c-a562a06746c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:07.815402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68527f55-e44c-41e1-b44c-a562a06746c8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:07.828170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 615/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:45:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:07.834669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:07.906604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:07.949065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18069482-68f3-4a5b-8846-24c33896b1e7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:07.987312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbbe71-0cf0-4b41-8d28-a59811af9c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:07.987962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbbe71-0cf0-4b41-8d28-a59811af9c62 None admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:07.988237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbbe71-0cf0-4b41-8d28-a59811af9c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:07.988563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbbe71-0cf0-4b41-8d28-a59811af9c62 None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/28ecb57b15c24e4488eb3c78413194f3/roles/d255dac55c5e4f468635e33a1d42d34a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:08.007843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbbe71-0cf0-4b41-8d28-a59811af9c62 None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=28ecb57b15c24e4488eb3c78413194f3, role_id=d255dac55c5e4f468635e33a1d42d34a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:08.009633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbbe71-0cf0-4b41-8d28-a59811af9c62 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:08.026512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 617/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:45:07 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/28ecb57b15c24e4488eb3c78413194f3/roles/d255dac55c5e4f468635e33a1d42d34a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:45:10.029022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c49d7-01f7-499d-bc21-5915525f7f68 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:10.029633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c49d7-01f7-499d-bc21-5915525f7f68 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:10.029633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c49d7-01f7-499d-bc21-5915525f7f68 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:10.031273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 616/1233] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:10.036664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ebc1-6757-4bf4-ba31-d222dcf8ec80 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:10.037150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ebc1-6757-4bf4-ba31-d222dcf8ec80 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:10.037416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ebc1-6757-4bf4-ba31-d222dcf8ec80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:10.055331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a571ebc1-6757-4bf4-ba31-d222dcf8ec80 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:10.057106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a571ebc1-6757-4bf4-ba31-d222dcf8ec80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:10.125500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 618/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:10.429626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c49d7-01f7-499d-bc21-5915525f7f68 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:10.455945 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:10.544902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c49d7-01f7-499d-bc21-5915525f7f68 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:10.586224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:10.586890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:10.587170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:10.587444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:10.597784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:45:10.604059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:10.605200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:10.606321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 617/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Wed Aug 24 08:45:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:10.611995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ebc1-6757-4bf4-ba31-d222dcf8ec80 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:10.662224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:10.720184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ebc1-6757-4bf4-ba31-d222dcf8ec80 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:10.755518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:10.756146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:10.756457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:10.756736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:10.757416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:10.757720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:10.759111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:10.768470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 619/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Wed Aug 24 08:45:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:10.775835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:10.879355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:10.899536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27cd08-5968-4b64-b3b5-d66d1448d51e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:10.945915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:10.946555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:10.946838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:10.947121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:10.957534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:10.959018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:10.974077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:10.975720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:10.976833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:10.976833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:10.976833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:10.976833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 618/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:10.982133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:11.096226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f17ee-004a-4f60-9668-388bf45c41b3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:11.106357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:11.133099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:11.133717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:11.134077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:11.134357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:11.135532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:11.135873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:11.137586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:11.153421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 620/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:11.160134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:11.269709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac86b03-71f5-43d3-9026-0d617d980f4c None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:11.306558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:11.307190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:11.307475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:11.307752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:11.310498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:11.315638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:11.317385 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:45:11.331698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:11.333164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:11.334223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 619/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:11.339959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:11.451782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a078fb5-a4f7-42aa-88ce-eb9be2f19f4f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:11.490831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:11.491451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:11.491723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:11.492040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:11.492860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:11.493272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:11.495383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:11.517317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 621/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 08:45:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:11.523267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:11.631208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a756a9-cc1d-4bf3-ae49-68ba65cc9b10 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:11.671302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:11.672174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:11.672792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:11.673206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:11.747154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:11.754080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:11.755598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:11.869951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 620/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:45:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:45:11.876326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:11.906579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:11.995619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af37bb8-06bc-4a6f-9777-f0239d103521 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:12.039631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:12.040354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:12.040692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:12.040982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:12.052653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:12.054455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:12.071154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:12.072945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:12.073908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:12.073908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:12.073908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:12.073908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 622/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:45:12.078758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:12.180425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:12.187645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd4b82-5be2-4f69-9b07-651c49ccabcc None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:12.222680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:12.223300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:12.223832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:12.224332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:12.225518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:12.226110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:12.227988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:12.240236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 621/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:12.247684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:12.340615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:12.363853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089325bf-82e8-4cd7-8695-26c2257cbd5a None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:12.404633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:12.405265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:12.405544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:12.405807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:12.412703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:12.414350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:45:12.427611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:12.428616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:12.429592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:12.434688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 623/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:45:12.435662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:12.549937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81536cc7-f328-4713-8eb3-1dfa21e12059 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:12.592091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf91cb-0cc2-4c8a-a5a2-daa984bc9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:12.592882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf91cb-0cc2-4c8a-a5a2-daa984bc9af0 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:12.593222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf91cb-0cc2-4c8a-a5a2-daa984bc9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:12.593505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf91cb-0cc2-4c8a-a5a2-daa984bc9af0 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:12.594538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf91cb-0cc2-4c8a-a5a2-daa984bc9af0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:12.594941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf91cb-0cc2-4c8a-a5a2-daa984bc9af0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:12.596684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf91cb-0cc2-4c8a-a5a2-daa984bc9af0 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:12.611372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 622/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:12.617996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:12.731885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187dbe-110c-4ba5-a9d1-7a5521133bc7 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:12.772760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713ba03-5165-49ac-88c0-d79012f67aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:12.773371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ba03-5165-49ac-88c0-d79012f67aae None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:12.773657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ba03-5165-49ac-88c0-d79012f67aae None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:12.773935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713ba03-5165-49ac-88c0-d79012f67aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:12.774665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713ba03-5165-49ac-88c0-d79012f67aae None admin] RBAC: Adding query filter params (role.id=d255dac55c5e4f468635e33a1d42d34a, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=28ecb57b15c24e4488eb3c78413194f3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:12.774976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713ba03-5165-49ac-88c0-d79012f67aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:12.776721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713ba03-5165-49ac-88c0-d79012f67aae None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:12.782999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 624/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:45:12 2022] GET /identity/v3/role_assignments?user.id=28ecb57b15c24e4488eb3c78413194f3&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=d255dac55c5e4f468635e33a1d42d34a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:14.840443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfcdc-94bd-4319-94e8-770cd731c2e7 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:14.840984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfcdc-94bd-4319-94e8-770cd731c2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:14.840984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dfcdc-94bd-4319-94e8-770cd731c2e7 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:14.842325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 623/1247] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:45:14.848265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d76a2-3601-4cd7-8898-83f78a9cd29a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:14.848751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d76a2-3601-4cd7-8898-83f78a9cd29a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:14.848868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d76a2-3601-4cd7-8898-83f78a9cd29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:14.855160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:14.867600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-993d76a2-3601-4cd7-8898-83f78a9cd29a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:14.868861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-993d76a2-3601-4cd7-8898-83f78a9cd29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:14.950820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 625/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:15.227609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfcdc-94bd-4319-94e8-770cd731c2e7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:15.246692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:15.342204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dfcdc-94bd-4319-94e8-770cd731c2e7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:15.380950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:15.381754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:15.382075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:15.382398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:15.395018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:45:15.399711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:15.401248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:15.402448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 624/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:15.407341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d76a2-3601-4cd7-8898-83f78a9cd29a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:15.522011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d76a2-3601-4cd7-8898-83f78a9cd29a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:15.556702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:15.564150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:15.564813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:15.565098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:15.565364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:15.566040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:15.566360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:15.567713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:15.579051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 626/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:15.585119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:15.671124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:15.698975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597c1f5-37d2-4e01-b279-7322bf5eb0cf None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:15.738050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:15.738743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:15.739018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:15.739298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:15.750976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:15.752621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:15.771165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:15.772266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:15.773211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:15.773211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:15.773211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:15.773211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 625/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:15.779730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:15.898107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac774e7-df6b-4635-b6db-8593171657e5 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:15.937061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:15.937749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:15.938041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:15.938397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:15.939085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:15.939425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:15.940997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:15.954387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 627/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:15.960914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:16.082101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efef3000-2898-47b1-9cb2-954376b38fa1 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:16.108773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:16.117467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:16.118138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:16.118421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:16.119267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:16.127477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:16.129024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:45:16.141076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:16.142196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:16.143313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 626/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:16.148196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:16.208034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:16.263667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c1af-6c4e-4982-bf7d-a6be04b14445 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:16.304089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:16.304724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:16.305007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:16.305306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:16.306156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:16.306484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:16.308030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:16.327716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 628/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 08:45:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:16.334449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:16.449361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76286c1-7338-4b6f-b788-97dc0e3f77f7 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:16.486470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:16.487082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:16.487353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:16.487626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:16.545065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:16.559398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:16.561058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:16.665082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 627/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:45:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 08:45:16.671627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:16.781295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc2433-ae75-4872-9823-a8e0b8a46e72 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:16.796776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:16.819263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:16.819896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:16.820189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:16.820508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:16.831375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:16.832984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:16.848558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:16.849707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:16.850596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:16.850596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:16.850596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:16.850596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 629/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:45:16.855995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:16.946748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:16.958567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f04d1-d1ba-45bf-8032-113174436a23 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:16.994796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:16.996311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:16.996670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:16.996949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:16.997676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:16.998086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:16.999626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:17.019119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 628/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:17.020597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:17.138164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44572e-3ac1-4f7c-968f-ec41ce1c0843 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:17.173622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:17.174254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:17.174544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:17.174819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:17.181486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:17.183115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:45:17.197597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:17.198673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:17.199572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 630/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:17.204765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:17.316818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a621fc-f44e-48e3-8c33-149bc42eb67d None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:17.355697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb104e-989f-4c91-9cf3-eff0c0c7d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:17.356372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb104e-989f-4c91-9cf3-eff0c0c7d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:17.356678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb104e-989f-4c91-9cf3-eff0c0c7d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:17.356953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb104e-989f-4c91-9cf3-eff0c0c7d7d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:17.357756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb104e-989f-4c91-9cf3-eff0c0c7d7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:17.358096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb104e-989f-4c91-9cf3-eff0c0c7d7d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:17.359613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb104e-989f-4c91-9cf3-eff0c0c7d7d1 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:17.372632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 629/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:17.379091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:17.407141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:17.491660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625a3d3-abe1-46f2-85b8-72c27f1c420b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:17.528943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424220a2-b3bb-427c-9a20-6713968b03b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:17.529663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424220a2-b3bb-427c-9a20-6713968b03b2 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:17.529943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424220a2-b3bb-427c-9a20-6713968b03b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:17.530213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424220a2-b3bb-427c-9a20-6713968b03b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:17.530962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424220a2-b3bb-427c-9a20-6713968b03b2 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=28ecb57b15c24e4488eb3c78413194f3) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:17.531269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424220a2-b3bb-427c-9a20-6713968b03b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:17.532770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424220a2-b3bb-427c-9a20-6713968b03b2 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:17.539180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 631/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:45:17 2022] GET /identity/v3/role_assignments?user.id=28ecb57b15c24e4488eb3c78413194f3&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=759ce9628735416988d65affdc29c636 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:19.460125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504d54-150e-41f5-9a53-c0ed79c85079 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:19.460710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504d54-150e-41f5-9a53-c0ed79c85079 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:19.460710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d504d54-150e-41f5-9a53-c0ed79c85079 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:19.462026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 630/1261] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:19.467484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f42d-8742-4fa3-b2d9-15898eff7197 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:19.467885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f42d-8742-4fa3-b2d9-15898eff7197 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:19.468034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044f42d-8742-4fa3-b2d9-15898eff7197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:19.489203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f044f42d-8742-4fa3-b2d9-15898eff7197 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:19.490472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f044f42d-8742-4fa3-b2d9-15898eff7197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:19.555116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 632/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:19.821089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d504d54-150e-41f5-9a53-c0ed79c85079 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:19.831785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:19.920088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d504d54-150e-41f5-9a53-c0ed79c85079 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:19.952632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:19.953246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:19.953524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:19.953790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:19.963504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:45:19.968063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:19.969236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:19.970101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 631/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 08:45:19.975157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f42d-8742-4fa3-b2d9-15898eff7197 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:19.994998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:20.077321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044f42d-8742-4fa3-b2d9-15898eff7197 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:20.109689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:20.110287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:20.110565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:20.110838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:20.111499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:20.111801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:20.113204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:20.121228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 633/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:45:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:20.127277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:20.194323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:20.230026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c305496-922f-4bd2-993b-d36540076208 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:20.262458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:20.263081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:20.263365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:20.263641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:20.273229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:20.275282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:20.289203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:20.290336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:20.291775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:20.291775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:20.291775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:20.291775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 632/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:20.296653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:20.375295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:20.393841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8fa2a-1ae3-4b9e-9b7f-aaac0d1f37ef None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:20.426386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:20.426984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:20.427263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:20.427535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:20.428177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:20.428512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:20.429888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:20.441474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 634/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:20.447152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:20.548480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a0e01-e8ba-4775-b44b-0c04838d161a None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:20.567124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:20.581615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:20.582247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:20.582530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:20.582804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] PATH_INFO: `/v3/users/placement` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:20.590945 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:20.592371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:45:20.603542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:20.604677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:20.605997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 633/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:20.610523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:20.707878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb0b82-6134-402d-98e2-c47527ae106b None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:20.740471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:20.741070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:20.741352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:20.741632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:20.742357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:20.742664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:20.745271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:20.753767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:20.763507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 635/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 08:45:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:20.769124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:20.865960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef3b32-d677-44da-ac23-5a13c99a76af None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:20.898154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:20.898762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:20.899044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:20.899314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:20.909706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:20.911134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:20.924881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:20.925978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:20.927261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:20.927261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:20.927261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:20.927261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 634/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:20.931809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:21.043026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8e3d8-261e-46ee-9b46-5a77a5c44a8f None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:21.075628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:21.076229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:21.076540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:21.076814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:21.077450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:21.077758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:21.079133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:21.090705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 636/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:21.096403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:21.127269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:21.192878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc8322-a651-4bb0-870e-d22e1921e868 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:21.224744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:21.225362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:21.225641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:21.225913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:21.232831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:21.234247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:45:21.245429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:21.246468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:21.247390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 635/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:21.252278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:21.309353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:21.350628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dab6-a129-4342-98bf-dd59df6c47fe None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:21.382500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2b94b-9dbb-412d-a13e-73b564340b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:21.383096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2b94b-9dbb-412d-a13e-73b564340b1c None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:21.383371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2b94b-9dbb-412d-a13e-73b564340b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:21.383638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2b94b-9dbb-412d-a13e-73b564340b1c None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:21.384873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2b94b-9dbb-412d-a13e-73b564340b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:21.385175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2b94b-9dbb-412d-a13e-73b564340b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:21.386860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2b94b-9dbb-412d-a13e-73b564340b1c None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:21.398240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 637/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:21.404861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:21.491595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:21.500366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b4980-0a71-46ea-96f7-47a9e84790a5 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:21.532931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7804e6-a7f0-4051-bf79-3fd5530ff7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:21.533568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804e6-a7f0-4051-bf79-3fd5530ff7fa None admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:21.533848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804e6-a7f0-4051-bf79-3fd5530ff7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:21.534123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804e6-a7f0-4051-bf79-3fd5530ff7fa None admin] PATH_INFO: `/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/28ecb57b15c24e4488eb3c78413194f3/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:21.535992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7804e6-a7f0-4051-bf79-3fd5530ff7fa None admin] RBAC: Authorizing `identity:create_grant(project_id=afe9de59ee464958ade8c90b4de6929a, user_id=28ecb57b15c24e4488eb3c78413194f3, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:21.537445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7804e6-a7f0-4051-bf79-3fd5530ff7fa None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:21.549290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 636/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Wed Aug 24 08:45:21 2022] PUT /identity/v3/projects/afe9de59ee464958ade8c90b4de6929a/users/28ecb57b15c24e4488eb3c78413194f3/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:45:23.413423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954e14-ef75-4508-a0a5-c42167644efa None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:23.413995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954e14-ef75-4508-a0a5-c42167644efa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:23.413995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954e14-ef75-4508-a0a5-c42167644efa None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:23.415301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 638/1274] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:23.420635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bb1af-a567-4e34-bb2d-f4278020d80f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:23.421027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bb1af-a567-4e34-bb2d-f4278020d80f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:23.421188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bb1af-a567-4e34-bb2d-f4278020d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:23.439130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-161bb1af-a567-4e34-bb2d-f4278020d80f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:23.440319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-161bb1af-a567-4e34-bb2d-f4278020d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:23.502885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 637/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:23.767210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954e14-ef75-4508-a0a5-c42167644efa None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:23.865531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954e14-ef75-4508-a0a5-c42167644efa None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:23.882797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:23.899243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:23.900446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:23.900726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:23.900995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:23.910764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 08:45:23.915973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:23.917111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:23.917973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 639/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Wed Aug 24 08:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:23.923096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bb1af-a567-4e34-bb2d-f4278020d80f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:24.005239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:24.024276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bb1af-a567-4e34-bb2d-f4278020d80f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:24.057668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:24.058272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:24.058556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:24.058832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:24.059499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:24.059805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:24.061194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:24.068943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 638/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Wed Aug 24 08:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:24.074700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:24.171061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a96bf1-d139-4f81-b28f-91d079de17a4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:24.202754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:24.203362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:24.203635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:24.203905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:24.213932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:24.215361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:24.229632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:24.230666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:24.231573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:24.231573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:24.231573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:24.231573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 640/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:24.236454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:24.333711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668236f-15a8-4101-936c-e2e6de1cad13 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:24.366055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:24.366651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:24.366933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:24.367209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:24.367885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:24.368253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:24.369671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:24.380877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 639/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:24.387306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:24.418161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:24.485271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b60742-da6d-421b-b8e7-858df55e32b4 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:24.517850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:24.518464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:24.518745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:24.519018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:24.526769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:24.528201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 08:45:24.538871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:24.539978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:24.541149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 641/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:24.545698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:24.549498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:24.644541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41150067-f62c-4edd-bdb1-e0de8e7fdeb2 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:24.676923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:24.677516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:24.677793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:24.678061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:24.678779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:24.679085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:24.680521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:24.697725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 640/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Wed Aug 24 08:45:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:24.703453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:24.789564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:24.799389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36fd1-0824-44f6-8205-3ab569edf1f3 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:24.832037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:24.832654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:24.832938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:24.833211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:24.897676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:24.899063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:24.983451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:24.995918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 642/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Wed Aug 24 08:45:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 08:45:25.003295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:25.063426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:25.099835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb4494-cc66-4971-99f2-253babbad559 None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:25.132638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:25.133252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:25.133534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:25.133835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:25.143626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:25.145145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 08:45:25.159010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:25.160121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 08:45:25.161084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 08:45:25.161084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 08:45:25.161084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:25.161084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 641/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:25.166255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:25.262616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3624e-6b2f-4f37-8a36-e2be916efa17 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:25.296237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:25.296877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:25.297220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:25.297496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:25.298135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:25.298440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:25.299812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:25.311268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 643/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Wed Aug 24 08:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:25.316912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:25.422608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0c4f5-8f63-4163-82e5-e5263a018b6e None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:25.436253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:25.456664 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:25.457293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:25.457578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:25.457855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:25.464256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:25.465789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 08:45:25.476768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:25.477847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: ERROR keystone.server.flask.application Aug 24 08:45:25.478815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 642/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Wed Aug 24 08:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:25.483769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:25.533261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:25.582818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b029f5-3122-44d4-9b7e-7df6acfa75fc None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:25.615347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2802cfa-6696-40ab-a8bb-987f6c22fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:25.615973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802cfa-6696-40ab-a8bb-987f6c22fb53 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:25.616255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802cfa-6696-40ab-a8bb-987f6c22fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:25.616559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802cfa-6696-40ab-a8bb-987f6c22fb53 None admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:25.617250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2802cfa-6696-40ab-a8bb-987f6c22fb53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:25.617578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2802cfa-6696-40ab-a8bb-987f6c22fb53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:25.619529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2802cfa-6696-40ab-a8bb-987f6c22fb53 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:25.631863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 644/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Wed Aug 24 08:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:25.638849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:25.736646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acab2e-33d4-4cfb-b562-5e95f5ad241b None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:25.769599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9284e2-8bea-4094-9575-7d1146c57be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:25.770183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9284e2-8bea-4094-9575-7d1146c57be8 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:25.770466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9284e2-8bea-4094-9575-7d1146c57be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:25.770740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9284e2-8bea-4094-9575-7d1146c57be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:25.771463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9284e2-8bea-4094-9575-7d1146c57be8 None admin] RBAC: Adding query filter params (role.id=759ce9628735416988d65affdc29c636, scope.project.id=afe9de59ee464958ade8c90b4de6929a, user.id=28ecb57b15c24e4488eb3c78413194f3) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:25.771772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9284e2-8bea-4094-9575-7d1146c57be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:25.773207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9284e2-8bea-4094-9575-7d1146c57be8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:25.779312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 643/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Wed Aug 24 08:45:25 2022] GET /identity/v3/role_assignments?user.id=28ecb57b15c24e4488eb3c78413194f3&scope.project.id=afe9de59ee464958ade8c90b4de6929a&role.id=759ce9628735416988d65affdc29c636 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:27.674834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26c34-49c6-4a4f-a9ec-35cff3be4af4 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:27.675383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26c34-49c6-4a4f-a9ec-35cff3be4af4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:27.675383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a26c34-49c6-4a4f-a9ec-35cff3be4af4 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:27.676739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 645/1288] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:27.682285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bca97-ad36-47d4-a8de-030845c43fec None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:27.682738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bca97-ad36-47d4-a8de-030845c43fec None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:27.682838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bca97-ad36-47d4-a8de-030845c43fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:27.701217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-788bca97-ad36-47d4-a8de-030845c43fec None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:27.702390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-788bca97-ad36-47d4-a8de-030845c43fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:27.730456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:27.768253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 644/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:28.058755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a26c34-49c6-4a4f-a9ec-35cff3be4af4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:28.164653 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a26c34-49c6-4a4f-a9ec-35cff3be4af4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:28.174921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:28.198732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:28.199360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:28.199639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:28.199908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:28.200513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:28.201890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:28.210258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:28.211514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:28.213482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 646/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:45:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:28.218007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bca97-ad36-47d4-a8de-030845c43fec None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:28.311562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bca97-ad36-47d4-a8de-030845c43fec None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:28.344045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87d2a6-0219-4296-880d-0676efbe7368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:28.344723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d2a6-0219-4296-880d-0676efbe7368 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:28.345004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d2a6-0219-4296-880d-0676efbe7368 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:28.345276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87d2a6-0219-4296-880d-0676efbe7368 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:28.345899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87d2a6-0219-4296-880d-0676efbe7368 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:28.346199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87d2a6-0219-4296-880d-0676efbe7368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:28.347551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87d2a6-0219-4296-880d-0676efbe7368 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:28.352149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 645/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 08:45:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:28.357790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:28.454161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334eb625-7c0c-492d-905c-cd6800a40ca9 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:28.485865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311f02-4edb-45ab-831b-4590d048f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:28.486453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311f02-4edb-45ab-831b-4590d048f576 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:28.486734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311f02-4edb-45ab-831b-4590d048f576 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:28.487004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311f02-4edb-45ab-831b-4590d048f576 None admin] PATH_INFO: `/v3/services` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:28.487621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311f02-4edb-45ab-831b-4590d048f576 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:28.487922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311f02-4edb-45ab-831b-4590d048f576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:28.489304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311f02-4edb-45ab-831b-4590d048f576 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:28.494083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 647/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 08:45:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:30.340994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55341b25-8ebd-4ac9-bb9d-f61da1d0b5fe None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:30.341550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55341b25-8ebd-4ac9-bb9d-f61da1d0b5fe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:30.341550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55341b25-8ebd-4ac9-bb9d-f61da1d0b5fe None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:30.342846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 646/1293] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:30.348177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8a1d-830e-4da7-810b-804a2e531600 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:30.348589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8a1d-830e-4da7-810b-804a2e531600 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:30.348823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa8a1d-830e-4da7-810b-804a2e531600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:30.368879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-15aa8a1d-830e-4da7-810b-804a2e531600 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:30.369836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-15aa8a1d-830e-4da7-810b-804a2e531600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:30.399590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:30.438111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 648/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:30.701420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55341b25-8ebd-4ac9-bb9d-f61da1d0b5fe None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:30.731061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:30.799014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55341b25-8ebd-4ac9-bb9d-f61da1d0b5fe None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:30.830356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9580547-9d8a-4067-900b-8f7fff0f80a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:30.830941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9580547-9d8a-4067-900b-8f7fff0f80a8 None admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:30.831220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9580547-9d8a-4067-900b-8f7fff0f80a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:30.831491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9580547-9d8a-4067-900b-8f7fff0f80a8 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:30.832118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9580547-9d8a-4067-900b-8f7fff0f80a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:30.833486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9580547-9d8a-4067-900b-8f7fff0f80a8 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:30.848582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 647/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Wed Aug 24 08:45:30 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:45:32.804269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d964-f885-40e7-8d9e-8acd8e673784 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:32.804859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d964-f885-40e7-8d9e-8acd8e673784 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:32.804859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0d964-f885-40e7-8d9e-8acd8e673784 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:32.806193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 649/1296] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:32.811422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59243be7-7f03-4a3f-a57f-33c659b7c82b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:32.811863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59243be7-7f03-4a3f-a57f-33c659b7c82b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:32.811983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59243be7-7f03-4a3f-a57f-33c659b7c82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:32.829968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-59243be7-7f03-4a3f-a57f-33c659b7c82b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:32.831073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-59243be7-7f03-4a3f-a57f-33c659b7c82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:32.900286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 648/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:33.163994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0d964-f885-40e7-8d9e-8acd8e673784 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:33.265031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0d964-f885-40e7-8d9e-8acd8e673784 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:33.298103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:33.298722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:33.299008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:33.299282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:33.299862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:33.301263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:33.310317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:33.311457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:33.312737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 650/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:45:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:33.317493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59243be7-7f03-4a3f-a57f-33c659b7c82b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:33.336118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:33.420341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59243be7-7f03-4a3f-a57f-33c659b7c82b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:33.454925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:33.455571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:33.455880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:33.456198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:33.456941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:33.457262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:33.458895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:33.464275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 649/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 08:45:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:33.470262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:33.509390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:33.580426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c74f6e-0c5a-46c2-959d-cc740ae3be29 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:33.614779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011e527-3cd3-48c6-8674-6fbec89992a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:33.615382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011e527-3cd3-48c6-8674-6fbec89992a3 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:33.615667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011e527-3cd3-48c6-8674-6fbec89992a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:33.615942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011e527-3cd3-48c6-8674-6fbec89992a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:33.616669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011e527-3cd3-48c6-8674-6fbec89992a3 None admin] RBAC: Adding query filter params (interface=public, service_id=a3e13052667a4e3cba34c98858d038f2, region_id=RegionOne) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:33.617340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011e527-3cd3-48c6-8674-6fbec89992a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:33.618995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011e527-3cd3-48c6-8674-6fbec89992a3 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:33.623901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 651/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Wed Aug 24 08:45:33 2022] GET /identity/v3/endpoints?service_id=a3e13052667a4e3cba34c98858d038f2&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:33.629626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:33.710944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:33.729858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7583c4-d809-4e06-a5b9-a745be61c23f None admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:33.765453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4e163-db03-44b8-8f21-8dc7d774678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:33.766081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4e163-db03-44b8-8f21-8dc7d774678e None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:33.766361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4e163-db03-44b8-8f21-8dc7d774678e None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:33.766637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4e163-db03-44b8-8f21-8dc7d774678e None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:33.767282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4e163-db03-44b8-8f21-8dc7d774678e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:33.768747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4e163-db03-44b8-8f21-8dc7d774678e None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:33.775772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 650/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Wed Aug 24 08:45:33 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:45:35.635998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f04-03f2-4e30-86a0-970999012f25 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:35.636563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f04-03f2-4e30-86a0-970999012f25 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:35.636644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f676f04-03f2-4e30-86a0-970999012f25 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:35.638036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 652/1302] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:45:35.643198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2677-057c-46bb-a1e3-e505b97227b7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:35.643585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2677-057c-46bb-a1e3-e505b97227b7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:35.643745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f2677-057c-46bb-a1e3-e505b97227b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:35.661219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d52f2677-057c-46bb-a1e3-e505b97227b7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:45:35.662370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d52f2677-057c-46bb-a1e3-e505b97227b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:45:35.726780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 651/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:45:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 08:45:35.996917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f676f04-03f2-4e30-86a0-970999012f25 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:36.092171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:36.099013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f676f04-03f2-4e30-86a0-970999012f25 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:36.131444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:36.132061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:36.132340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:36.132643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:36.133231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:36.134598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 08:45:36.143246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 08:45:36.144241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application with Lock( Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self._enter() Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application return self.creator() Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application created_value = creator( Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: ERROR keystone.server.flask.application Aug 24 08:45:36.145137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 653/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Wed Aug 24 08:45:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 08:45:36.150876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f2677-057c-46bb-a1e3-e505b97227b7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:36.223555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:36.246418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f2677-057c-46bb-a1e3-e505b97227b7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:36.285086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae427d13-d4e6-43d2-894b-63369848cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:36.285652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427d13-d4e6-43d2-894b-63369848cd92 None admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:36.285888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427d13-d4e6-43d2-894b-63369848cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:36.286162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae427d13-d4e6-43d2-894b-63369848cd92 None admin] PATH_INFO: `/v3/services` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:36.286794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae427d13-d4e6-43d2-894b-63369848cd92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:45:36.287097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae427d13-d4e6-43d2-894b-63369848cd92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:36.288481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae427d13-d4e6-43d2-894b-63369848cd92 None admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:36.293511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 652/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Wed Aug 24 08:45:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:45:36.299704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:45:36.396790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26883589-3046-4d33-b04e-ecf642c21170 None admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:45:36.429238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e160-13f9-4950-8818-2cc67b1bfaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:45:36.429823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e160-13f9-4950-8818-2cc67b1bfaf9 None admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:45:36.430138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e160-13f9-4950-8818-2cc67b1bfaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:45:36.430411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e160-13f9-4950-8818-2cc67b1bfaf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:45:36.431056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e160-13f9-4950-8818-2cc67b1bfaf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:45:36.432434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e160-13f9-4950-8818-2cc67b1bfaf9 None admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:45:36.451777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 654/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:45:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:45:46.291003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=30 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:45:46.447562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:40.001914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10726fe2-b207-4e43-939d-fc4d0c1aff86 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:40.002390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10726fe2-b207-4e43-939d-fc4d0c1aff86 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:40.002471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10726fe2-b207-4e43-939d-fc4d0c1aff86 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:40.009302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a6da-a436-4aca-99fc-042058e407cc None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:40.009708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a6da-a436-4aca-99fc-042058e407cc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:40.009850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5a6da-a436-4aca-99fc-042058e407cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:40.012476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 653/1307] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:46:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:40.189787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a7b5a6da-a436-4aca-99fc-042058e407cc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:40.193828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a7b5a6da-a436-4aca-99fc-042058e407cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:40.325540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 655/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:46:40.624221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fc4a-8d86-49e4-8e9f-abcf6a827213 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:40.624957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fc4a-8d86-49e4-8e9f-abcf6a827213 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:40.625242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fc4a-8d86-49e4-8e9f-abcf6a827213 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:40.627057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 654/1309] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 24 08:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:40.634463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c03c-1334-4f2e-9ed0-63b33d2f2495 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:40.634902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c03c-1334-4f2e-9ed0-63b33d2f2495 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:40.635301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c03c-1334-4f2e-9ed0-63b33d2f2495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:40.723212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6d84c03c-1334-4f2e-9ed0-63b33d2f2495 None None] MFA Rules not processed for user `7194e3fe0d2d46ada270bb440cd79911`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:40.724659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6d84c03c-1334-4f2e-9ed0-63b33d2f2495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:40.750157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:40.814341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 656/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 24 08:46:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:46:40.824326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fc4a-8d86-49e4-8e9f-abcf6a827213 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:46:40.826237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5a46fc4a-8d86-49e4-8e9f-abcf6a827213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:40.947162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fc4a-8d86-49e4-8e9f-abcf6a827213 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:46:41.028715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14057a8e-5fbd-4323-b216-749714aaa518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:46:41.029361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14057a8e-5fbd-4323-b216-749714aaa518 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:41.029520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14057a8e-5fbd-4323-b216-749714aaa518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:41.029794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14057a8e-5fbd-4323-b216-749714aaa518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:41.031396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-14057a8e-5fbd-4323-b216-749714aaa518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:41.089527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:41.147731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14057a8e-5fbd-4323-b216-749714aaa518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:46:41.149207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14057a8e-5fbd-4323-b216-749714aaa518 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:46:41.169791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 655/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:46:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:46:43.381025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71c260-72eb-4240-9414-2d1b03bac548 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:43.381501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71c260-72eb-4240-9414-2d1b03bac548 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:43.381600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71c260-72eb-4240-9414-2d1b03bac548 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:43.383117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 657/1312] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:43.388892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d6b2-587f-4f14-85d8-a90c851582b4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:43.389361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d6b2-587f-4f14-85d8-a90c851582b4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:43.389545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d6b2-587f-4f14-85d8-a90c851582b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:43.469327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fd50d6b2-587f-4f14-85d8-a90c851582b4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:43.470568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fd50d6b2-587f-4f14-85d8-a90c851582b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:43.564580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 656/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:46:43.845104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71c260-72eb-4240-9414-2d1b03bac548 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:46:43.846660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5f71c260-72eb-4240-9414-2d1b03bac548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:43.949592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71c260-72eb-4240-9414-2d1b03bac548 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:46:44.018102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:44.021274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67636f7b-f407-4160-a582-e8b34f8ce49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:46:44.022077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67636f7b-f407-4160-a582-e8b34f8ce49a service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:44.022589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67636f7b-f407-4160-a582-e8b34f8ce49a service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:44.023060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67636f7b-f407-4160-a582-e8b34f8ce49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:44.024719 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-67636f7b-f407-4160-a582-e8b34f8ce49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:44.129839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67636f7b-f407-4160-a582-e8b34f8ce49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:46:44.131199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67636f7b-f407-4160-a582-e8b34f8ce49a service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:46:44.149631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 658/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:46:46.388271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34f6a-9b0a-4c1d-8cc4-1ee028fc9f8b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:46.388776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34f6a-9b0a-4c1d-8cc4-1ee028fc9f8b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:46.388883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd34f6a-9b0a-4c1d-8cc4-1ee028fc9f8b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:46.390265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 657/1315] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:46.396016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0959-858b-442e-b08d-7200d64a483c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:46.396424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0959-858b-442e-b08d-7200d64a483c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:46.396607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd0959-858b-442e-b08d-7200d64a483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:46.462615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-14fd0959-858b-442e-b08d-7200d64a483c None None] MFA Rules not processed for user `bc03d5a587d1460788d92e5aee9807ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:46.463853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-14fd0959-858b-442e-b08d-7200d64a483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:46.515042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:46.559758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 659/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:46:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:46:46.850365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd34f6a-9b0a-4c1d-8cc4-1ee028fc9f8b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:46:46.851873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9bd34f6a-9b0a-4c1d-8cc4-1ee028fc9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:46.861473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:46.955821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd34f6a-9b0a-4c1d-8cc4-1ee028fc9f8b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:46:47.027623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dee2c-aee6-4d6b-b8b2-dfb314563fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:46:47.028228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dee2c-aee6-4d6b-b8b2-dfb314563fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:47.028538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dee2c-aee6-4d6b-b8b2-dfb314563fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:47.028813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dee2c-aee6-4d6b-b8b2-dfb314563fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:47.030408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ab7dee2c-aee6-4d6b-b8b2-dfb314563fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:47.090872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:47.136872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dee2c-aee6-4d6b-b8b2-dfb314563fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:46:47.138237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dee2c-aee6-4d6b-b8b2-dfb314563fc7 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:46:47.157715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 658/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:46:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:46:49.554426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0973ec-49a2-49ac-ba18-d9c74f7aedec None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:49.554952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0973ec-49a2-49ac-ba18-d9c74f7aedec None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:49.554952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0973ec-49a2-49ac-ba18-d9c74f7aedec None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:49.556314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 660/1318] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:49.561582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322d0d-6b7a-4ebb-85cd-5b6e6a898d57 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:49.562029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322d0d-6b7a-4ebb-85cd-5b6e6a898d57 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:49.562152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322d0d-6b7a-4ebb-85cd-5b6e6a898d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:49.626784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-99322d0d-6b7a-4ebb-85cd-5b6e6a898d57 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:49.627935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-99322d0d-6b7a-4ebb-85cd-5b6e6a898d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:49.721984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 659/1319] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:46:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:46:50.009213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0973ec-49a2-49ac-ba18-d9c74f7aedec None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:46:50.010729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7d0973ec-49a2-49ac-ba18-d9c74f7aedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:50.114031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0973ec-49a2-49ac-ba18-d9c74f7aedec None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:46:50.185225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74617aa-838f-48d1-b3e8-68aab8182f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:46:50.185854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617aa-838f-48d1-b3e8-68aab8182f5f service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:50.186135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617aa-838f-48d1-b3e8-68aab8182f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:50.186406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617aa-838f-48d1-b3e8-68aab8182f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:50.187987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b74617aa-838f-48d1-b3e8-68aab8182f5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:50.195429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:50.296402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74617aa-838f-48d1-b3e8-68aab8182f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:46:50.297799 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74617aa-838f-48d1-b3e8-68aab8182f5f service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:46:50.315337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 661/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:46:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:46:52.865042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c1cf-2264-49f5-88fe-2eda66642eac None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:52.865557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c1cf-2264-49f5-88fe-2eda66642eac None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:52.865557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222c1cf-2264-49f5-88fe-2eda66642eac None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:52.866843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 660/1321] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:52.872176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7557f-e919-4bea-a5e6-cd60eaacfe41 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:52.872631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7557f-e919-4bea-a5e6-cd60eaacfe41 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:52.872782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7557f-e919-4bea-a5e6-cd60eaacfe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:52.938534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a6f7557f-e919-4bea-a5e6-cd60eaacfe41 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:52.939721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a6f7557f-e919-4bea-a5e6-cd60eaacfe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:53.000541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:53.041295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 662/1322] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:46:53.326908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222c1cf-2264-49f5-88fe-2eda66642eac None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:46:53.328537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8222c1cf-2264-49f5-88fe-2eda66642eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:53.348890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:53.432705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222c1cf-2264-49f5-88fe-2eda66642eac None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:46:53.507138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617848dd-bb2c-4bb7-a5e0-9f369f0a4d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:46:53.507634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617848dd-bb2c-4bb7-a5e0-9f369f0a4d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:53.507916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617848dd-bb2c-4bb7-a5e0-9f369f0a4d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:53.508197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617848dd-bb2c-4bb7-a5e0-9f369f0a4d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:53.510070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-617848dd-bb2c-4bb7-a5e0-9f369f0a4d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:53.592336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:53.630520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617848dd-bb2c-4bb7-a5e0-9f369f0a4d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:46:53.631948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617848dd-bb2c-4bb7-a5e0-9f369f0a4d79 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:46:53.649657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 661/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:46:55.621010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6109b5-5829-4b9b-a2ff-93fd71851001 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:55.621566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6109b5-5829-4b9b-a2ff-93fd71851001 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:55.621566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6109b5-5829-4b9b-a2ff-93fd71851001 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:55.623053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 663/1324] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:55.628106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c4238-0b4f-47a9-9d99-e51851e8df46 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:55.629077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c4238-0b4f-47a9-9d99-e51851e8df46 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:55.629298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c4238-0b4f-47a9-9d99-e51851e8df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:55.695180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a79c4238-0b4f-47a9-9d99-e51851e8df46 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:55.696401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a79c4238-0b4f-47a9-9d99-e51851e8df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:55.790586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 662/1325] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:46:56.075786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6109b5-5829-4b9b-a2ff-93fd71851001 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:46:56.077430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2a6109b5-5829-4b9b-a2ff-93fd71851001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:56.188315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6109b5-5829-4b9b-a2ff-93fd71851001 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:46:56.263579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a315b-a99d-45cc-af82-43027da10fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:46:56.264186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a315b-a99d-45cc-af82-43027da10fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:56.264488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a315b-a99d-45cc-af82-43027da10fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:56.264756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a315b-a99d-45cc-af82-43027da10fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:56.266328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-377a315b-a99d-45cc-af82-43027da10fd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:56.285932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:56.379099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a315b-a99d-45cc-af82-43027da10fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:46:56.380598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a315b-a99d-45cc-af82-43027da10fd8 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:46:56.399504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 664/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:46:58.365001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517fe6-1abc-46ff-946f-d7f9526b4b15 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:58.365588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517fe6-1abc-46ff-946f-d7f9526b4b15 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:58.365588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35517fe6-1abc-46ff-946f-d7f9526b4b15 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:58.366937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 663/1327] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:46:58.372962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de626118-cc4c-43b3-9f43-c90c0943b972 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:58.373513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de626118-cc4c-43b3-9f43-c90c0943b972 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:58.373672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de626118-cc4c-43b3-9f43-c90c0943b972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:58.440401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-de626118-cc4c-43b3-9f43-c90c0943b972 None None] MFA Rules not processed for user `bc03d5a587d1460788d92e5aee9807ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:46:58.441621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de626118-cc4c-43b3-9f43-c90c0943b972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:58.513466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:58.547015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 665/1328] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:46:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:46:58.832717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35517fe6-1abc-46ff-946f-d7f9526b4b15 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:46:58.834334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-35517fe6-1abc-46ff-946f-d7f9526b4b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:58.867442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:58.941107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35517fe6-1abc-46ff-946f-d7f9526b4b15 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:46:59.013620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8562c-fde5-46f4-9251-7cd7cdac41a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:46:59.014157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8562c-fde5-46f4-9251-7cd7cdac41a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:46:59.014440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8562c-fde5-46f4-9251-7cd7cdac41a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:46:59.014716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8562c-fde5-46f4-9251-7cd7cdac41a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:46:59.016310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7cf8562c-fde5-46f4-9251-7cd7cdac41a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:46:59.093744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:46:59.125928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8562c-fde5-46f4-9251-7cd7cdac41a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:46:59.127368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8562c-fde5-46f4-9251-7cd7cdac41a2 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:46:59.146287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 664/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:46:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:01.278220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359dc2-5bd7-4486-b32c-94d78d364d5c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:01.278816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359dc2-5bd7-4486-b32c-94d78d364d5c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:01.278816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359dc2-5bd7-4486-b32c-94d78d364d5c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:01.280131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 666/1330] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:01.285472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f034-1f8c-44f6-9e14-b9f3775ad3eb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:01.285874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f034-1f8c-44f6-9e14-b9f3775ad3eb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:01.286037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98f034-1f8c-44f6-9e14-b9f3775ad3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:01.350133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cc98f034-1f8c-44f6-9e14-b9f3775ad3eb None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:01.351336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cc98f034-1f8c-44f6-9e14-b9f3775ad3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:01.450763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 665/1331] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:01.728856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359dc2-5bd7-4486-b32c-94d78d364d5c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:01.730388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-73359dc2-5bd7-4486-b32c-94d78d364d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:01.831981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73359dc2-5bd7-4486-b32c-94d78d364d5c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:01.903583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe3944-a2d4-4366-a814-01e66dd4788b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:01.904190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe3944-a2d4-4366-a814-01e66dd4788b service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:01.904506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe3944-a2d4-4366-a814-01e66dd4788b service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:01.904780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe3944-a2d4-4366-a814-01e66dd4788b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:01.906371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dbfe3944-a2d4-4366-a814-01e66dd4788b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:01.933303 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:02.017492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe3944-a2d4-4366-a814-01e66dd4788b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:02.018937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe3944-a2d4-4366-a814-01e66dd4788b service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:02.037759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 667/1332] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:03.974119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c826f-ad45-470d-9009-f597413fac07 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:03.974684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c826f-ad45-470d-9009-f597413fac07 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:03.974684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c826f-ad45-470d-9009-f597413fac07 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:03.976024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 666/1333] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:03.981389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160eb56-268e-49ea-92bb-52afbd127824 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:03.981827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160eb56-268e-49ea-92bb-52afbd127824 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:03.981947 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160eb56-268e-49ea-92bb-52afbd127824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:04.048134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a160eb56-268e-49ea-92bb-52afbd127824 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:04.049401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a160eb56-268e-49ea-92bb-52afbd127824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:04.124026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:04.146483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 668/1334] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:04.450560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e677-bd01-41c9-8dbc-1ca27847193a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:04.450847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e677-bd01-41c9-8dbc-1ca27847193a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:04.451124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987e677-bd01-41c9-8dbc-1ca27847193a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:04.452506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 667/1335] 10.222.0.42 () {54 vars in 965 bytes} [Wed Aug 24 08:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:04.458759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4554703-a6bf-477e-b483-159b7d6c4050 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:04.459044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4554703-a6bf-477e-b483-159b7d6c4050 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:04.459317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4554703-a6bf-477e-b483-159b7d6c4050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:04.535142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b4554703-a6bf-477e-b483-159b7d6c4050 None None] MFA Rules not processed for user `7194e3fe0d2d46ada270bb440cd79911`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:04.544635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b4554703-a6bf-477e-b483-159b7d6c4050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:04.611733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 669/1336] 10.222.0.42 () {58 vars in 1062 bytes} [Wed Aug 24 08:47:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:04.620735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e677-bd01-41c9-8dbc-1ca27847193a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:04.622232 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6987e677-bd01-41c9-8dbc-1ca27847193a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:04.662328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:04.725982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987e677-bd01-41c9-8dbc-1ca27847193a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:04.796921 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5990d-2d3d-4be1-84c2-d3397f99db44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:04.797528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5990d-2d3d-4be1-84c2-d3397f99db44 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:04.797807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5990d-2d3d-4be1-84c2-d3397f99db44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:04.798079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5990d-2d3d-4be1-84c2-d3397f99db44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:04.799957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-26c5990d-2d3d-4be1-84c2-d3397f99db44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:04.879238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:04.905219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5990d-2d3d-4be1-84c2-d3397f99db44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:04.906644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5990d-2d3d-4be1-84c2-d3397f99db44 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:04.923887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 668/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:07.653223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac55e-59ab-4410-8d37-692118e0ab5e None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:07.653704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac55e-59ab-4410-8d37-692118e0ab5e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:07.653824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaac55e-59ab-4410-8d37-692118e0ab5e None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:07.655083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 670/1338] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:07.660986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ed4e5-23a4-4a9d-9331-43fddf1153ff None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:07.661417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ed4e5-23a4-4a9d-9331-43fddf1153ff None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:07.661528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ed4e5-23a4-4a9d-9331-43fddf1153ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:07.725230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-395ed4e5-23a4-4a9d-9331-43fddf1153ff None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:07.726420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-395ed4e5-23a4-4a9d-9331-43fddf1153ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:07.819260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 669/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:08.105660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac55e-59ab-4410-8d37-692118e0ab5e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:08.107197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2eaac55e-59ab-4410-8d37-692118e0ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:08.182688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:08.210655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaac55e-59ab-4410-8d37-692118e0ab5e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:08.285422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944467b-9720-4e02-9dcf-5399508779cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:08.286022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944467b-9720-4e02-9dcf-5399508779cb service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:08.286298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944467b-9720-4e02-9dcf-5399508779cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:08.286567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944467b-9720-4e02-9dcf-5399508779cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:08.288125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4944467b-9720-4e02-9dcf-5399508779cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:08.393109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944467b-9720-4e02-9dcf-5399508779cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:08.394467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944467b-9720-4e02-9dcf-5399508779cb service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:08.411852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 671/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:12.358961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e8b2-7216-47f8-a6b8-d961f54793f8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:12.359485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e8b2-7216-47f8-a6b8-d961f54793f8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:12.359485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86e8b2-7216-47f8-a6b8-d961f54793f8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:12.360910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 670/1341] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:12.366695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4e941-2a79-4b3b-afbe-6a35bf249225 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:12.367088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4e941-2a79-4b3b-afbe-6a35bf249225 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:12.367263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4e941-2a79-4b3b-afbe-6a35bf249225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:12.372609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:12.433597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1ca4e941-2a79-4b3b-afbe-6a35bf249225 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:12.434772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ca4e941-2a79-4b3b-afbe-6a35bf249225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:12.528052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 672/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:12.808964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e8b2-7216-47f8-a6b8-d961f54793f8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:12.810516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e86e8b2-7216-47f8-a6b8-d961f54793f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:12.858307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:12.915687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86e8b2-7216-47f8-a6b8-d961f54793f8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:12.990537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ae145-58fe-44bf-844c-af424c94664f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:12.991198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ae145-58fe-44bf-844c-af424c94664f service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:12.991681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ae145-58fe-44bf-844c-af424c94664f service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:12.991890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ae145-58fe-44bf-844c-af424c94664f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:12.993996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-642ae145-58fe-44bf-844c-af424c94664f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:13.090135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:13.107216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ae145-58fe-44bf-844c-af424c94664f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:13.108761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ae145-58fe-44bf-844c-af424c94664f service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:13.127228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 671/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:15.632276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42bf9-7cc2-486b-bd30-340c1774aaab None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:15.633144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42bf9-7cc2-486b-bd30-340c1774aaab None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:15.633144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42bf9-7cc2-486b-bd30-340c1774aaab None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:15.634461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 673/1344] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:15.640007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370ff9-ec0d-49b7-a3a0-42d55d8cd1dd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:15.640533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370ff9-ec0d-49b7-a3a0-42d55d8cd1dd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:15.640632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370ff9-ec0d-49b7-a3a0-42d55d8cd1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:15.708872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-20370ff9-ec0d-49b7-a3a0-42d55d8cd1dd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:15.710073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-20370ff9-ec0d-49b7-a3a0-42d55d8cd1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:15.805055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 672/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:16.089094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42bf9-7cc2-486b-bd30-340c1774aaab None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:16.090638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-50a42bf9-7cc2-486b-bd30-340c1774aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:16.176996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:16.194459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42bf9-7cc2-486b-bd30-340c1774aaab None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:16.269402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea13d5a-c9aa-47e3-900f-3d417edc2bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:16.270020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea13d5a-c9aa-47e3-900f-3d417edc2bcb service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:16.270302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea13d5a-c9aa-47e3-900f-3d417edc2bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:16.270577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea13d5a-c9aa-47e3-900f-3d417edc2bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:16.272193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2ea13d5a-c9aa-47e3-900f-3d417edc2bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:16.387775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea13d5a-c9aa-47e3-900f-3d417edc2bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:16.389175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea13d5a-c9aa-47e3-900f-3d417edc2bcb service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:16.407236 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 674/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:20.263836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f2bc-35ea-48ad-a605-4d14fbf8236e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:20.264291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f2bc-35ea-48ad-a605-4d14fbf8236e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:20.264438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f2bc-35ea-48ad-a605-4d14fbf8236e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:20.265792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 673/1347] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:20.272430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2966a7-f970-4eb5-80b5-503156aaff10 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:20.272895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2966a7-f970-4eb5-80b5-503156aaff10 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:20.272991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2966a7-f970-4eb5-80b5-503156aaff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:20.290865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:20.350301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5f2966a7-f970-4eb5-80b5-503156aaff10 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:20.353317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5f2966a7-f970-4eb5-80b5-503156aaff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:20.465929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 675/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:20.753586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90f2bc-35ea-48ad-a605-4d14fbf8236e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:20.755100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2b90f2bc-35ea-48ad-a605-4d14fbf8236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:20.815794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:20.863502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90f2bc-35ea-48ad-a605-4d14fbf8236e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:20.939136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f5cb4-7872-4719-8c4f-f5b792848504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:20.940370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f5cb4-7872-4719-8c4f-f5b792848504 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:20.940673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f5cb4-7872-4719-8c4f-f5b792848504 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:20.940945 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f5cb4-7872-4719-8c4f-f5b792848504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:20.942551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-730f5cb4-7872-4719-8c4f-f5b792848504 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:21.051130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:21.055242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f5cb4-7872-4719-8c4f-f5b792848504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:21.057095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f5cb4-7872-4719-8c4f-f5b792848504 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:21.075674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 674/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:25.890576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b274-056e-4da5-a075-695e6950b15b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:25.891077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b274-056e-4da5-a075-695e6950b15b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:25.891182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6b274-056e-4da5-a075-695e6950b15b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:25.893403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 676/1350] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:25.898553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad183-a46c-4b05-bcd3-4427f18a5aa3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:25.899008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad183-a46c-4b05-bcd3-4427f18a5aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:25.899123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ad183-a46c-4b05-bcd3-4427f18a5aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:26.004900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-039ad183-a46c-4b05-bcd3-4427f18a5aa3 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:26.006411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-039ad183-a46c-4b05-bcd3-4427f18a5aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:26.138070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 675/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:47:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:30.408862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160c758-2808-4f00-8b2b-1df948b96264 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:30.409808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160c758-2808-4f00-8b2b-1df948b96264 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:30.410257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160c758-2808-4f00-8b2b-1df948b96264 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:30.411903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 677/1352] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:30.417074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbc7a-721c-46d4-8ae1-8229211a97a8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:30.417490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbc7a-721c-46d4-8ae1-8229211a97a8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:30.417624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cbc7a-721c-46d4-8ae1-8229211a97a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:30.463670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=59 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:30.476017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:30.503142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-903cbc7a-721c-46d4-8ae1-8229211a97a8 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:30.504669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-903cbc7a-721c-46d4-8ae1-8229211a97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:30.620254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 676/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:47:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:32.026598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fa36-407c-4ddb-916c-ed29a256431e None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:32.027154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fa36-407c-4ddb-916c-ed29a256431e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:32.027392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7fa36-407c-4ddb-916c-ed29a256431e None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:32.029757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 678/1354] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:47:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:32.035901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81802-e6e5-46aa-8724-30fe477157e3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:32.036424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81802-e6e5-46aa-8724-30fe477157e3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:32.036938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced81802-e6e5-46aa-8724-30fe477157e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:32.113840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ced81802-e6e5-46aa-8724-30fe477157e3 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:32.115035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ced81802-e6e5-46aa-8724-30fe477157e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:32.155791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:32.220979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 677/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:47:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:47:35.550506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836471e-45ad-4ce1-aeee-cb9ca0ece289 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:35.551048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836471e-45ad-4ce1-aeee-cb9ca0ece289 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:35.551048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836471e-45ad-4ce1-aeee-cb9ca0ece289 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:35.552411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 679/1356] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:35.557768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863f79-6f4c-425d-95af-d8f8b6905d0d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:35.558217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863f79-6f4c-425d-95af-d8f8b6905d0d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:35.558394 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb863f79-6f4c-425d-95af-d8f8b6905d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:35.648153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fb863f79-6f4c-425d-95af-d8f8b6905d0d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:35.649409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fb863f79-6f4c-425d-95af-d8f8b6905d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:35.767582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 678/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:47:36.070624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20dc50-1fb9-4f6d-a9dc-a99f800114bd None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:36.071718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20dc50-1fb9-4f6d-a9dc-a99f800114bd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:36.072368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20dc50-1fb9-4f6d-a9dc-a99f800114bd None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:36.074310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 680/1358] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 08:47:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:36.084148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55ed0-2b36-4047-bc6c-3730843c035b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:36.084148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55ed0-2b36-4047-bc6c-3730843c035b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:36.084704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a55ed0-2b36-4047-bc6c-3730843c035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:36.108239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:36.195983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b2a55ed0-2b36-4047-bc6c-3730843c035b None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:36.197234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b2a55ed0-2b36-4047-bc6c-3730843c035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:36.318525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 679/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 08:47:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:36.326283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20dc50-1fb9-4f6d-a9dc-a99f800114bd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:36.328213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9d20dc50-1fb9-4f6d-a9dc-a99f800114bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:36.483553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20dc50-1fb9-4f6d-a9dc-a99f800114bd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:36.562581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:36.609479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2277ef-8494-4ccd-b186-62d12e415901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:36.611022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2277ef-8494-4ccd-b186-62d12e415901 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:36.611538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2277ef-8494-4ccd-b186-62d12e415901 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:36.612023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2277ef-8494-4ccd-b186-62d12e415901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:36.613870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ac2277ef-8494-4ccd-b186-62d12e415901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:36.710471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2277ef-8494-4ccd-b186-62d12e415901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:36.712069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2277ef-8494-4ccd-b186-62d12e415901 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:36.731194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 681/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:38.873774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d427f-2d85-4ae0-9c4f-cab962e825aa None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:38.874336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d427f-2d85-4ae0-9c4f-cab962e825aa None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:38.874695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d427f-2d85-4ae0-9c4f-cab962e825aa None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:38.876791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 680/1361] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:38.882440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4453-9a8f-4226-9ead-d660635b6a0a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:38.882880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4453-9a8f-4226-9ead-d660635b6a0a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:38.882977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af4453-9a8f-4226-9ead-d660635b6a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:38.953680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c9af4453-9a8f-4226-9ead-d660635b6a0a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:38.955033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c9af4453-9a8f-4226-9ead-d660635b6a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:38.996224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:39.067529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 682/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:39.374831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d427f-2d85-4ae0-9c4f-cab962e825aa None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:39.376998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-138d427f-2d85-4ae0-9c4f-cab962e825aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:39.450749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:39.544156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d427f-2d85-4ae0-9c4f-cab962e825aa None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:39.676409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd31620-9993-4cab-9684-d2d0be16f518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:39.677036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31620-9993-4cab-9684-d2d0be16f518 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:39.677319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31620-9993-4cab-9684-d2d0be16f518 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:39.677588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd31620-9993-4cab-9684-d2d0be16f518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:39.679153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9dd31620-9993-4cab-9684-d2d0be16f518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:39.705638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:39.784001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd31620-9993-4cab-9684-d2d0be16f518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:39.785679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd31620-9993-4cab-9684-d2d0be16f518 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:39.805243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 681/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:42.170752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b147d-8f0b-421b-b7ca-d7a2926568ea None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:42.171300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b147d-8f0b-421b-b7ca-d7a2926568ea None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:42.171300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b147d-8f0b-421b-b7ca-d7a2926568ea None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:42.173228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 683/1364] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:42.179550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2025-2fb8-479b-8052-9f3fd063d8b5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:42.179550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2025-2fb8-479b-8052-9f3fd063d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:42.179550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a2025-2fb8-479b-8052-9f3fd063d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:42.256129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-689a2025-2fb8-479b-8052-9f3fd063d8b5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:42.257645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-689a2025-2fb8-479b-8052-9f3fd063d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:42.373894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:42.385137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 682/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:42.672411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7ce8b-4608-4aa7-9711-574b3a0ff47e None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:42.672698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7ce8b-4608-4aa7-9711-574b3a0ff47e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:42.673149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7ce8b-4608-4aa7-9711-574b3a0ff47e None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:42.675039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 684/1366] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 08:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:42.681612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba632c-2548-4500-b6ac-a60ebfd56080 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:42.681985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba632c-2548-4500-b6ac-a60ebfd56080 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:42.682210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba632c-2548-4500-b6ac-a60ebfd56080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:42.767010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c6ba632c-2548-4500-b6ac-a60ebfd56080 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:42.768265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c6ba632c-2548-4500-b6ac-a60ebfd56080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:42.891869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 683/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 08:47:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:42.900149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7ce8b-4608-4aa7-9711-574b3a0ff47e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:42.901757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e9f7ce8b-4608-4aa7-9711-574b3a0ff47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:43.084423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7ce8b-4608-4aa7-9711-574b3a0ff47e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:43.106940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:43.210102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96868a8-6046-4a67-a93a-f07f9c86cb79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:43.210875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96868a8-6046-4a67-a93a-f07f9c86cb79 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:43.211278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96868a8-6046-4a67-a93a-f07f9c86cb79 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:43.211663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96868a8-6046-4a67-a93a-f07f9c86cb79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:43.213431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a96868a8-6046-4a67-a93a-f07f9c86cb79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:43.306496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96868a8-6046-4a67-a93a-f07f9c86cb79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:43.308105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96868a8-6046-4a67-a93a-f07f9c86cb79 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:43.326904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 685/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:43.971042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63291-bdc2-4c16-8dd0-c8cd7f878e27 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:43.971602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63291-bdc2-4c16-8dd0-c8cd7f878e27 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:43.971602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63291-bdc2-4c16-8dd0-c8cd7f878e27 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:43.973128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 684/1369] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:47:43.978718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b953-8f1a-4e2f-b83e-8ce22361425b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:43.979010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b953-8f1a-4e2f-b83e-8ce22361425b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:43.979290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8b953-8f1a-4e2f-b83e-8ce22361425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:44.021572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:44.061556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-97b8b953-8f1a-4e2f-b83e-8ce22361425b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:44.062879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-97b8b953-8f1a-4e2f-b83e-8ce22361425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:44.191977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 686/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:44.823073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72a31-69e6-4a13-9f1b-a9bad68f39e8 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:44.823073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72a31-69e6-4a13-9f1b-a9bad68f39e8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:44.823073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72a31-69e6-4a13-9f1b-a9bad68f39e8 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:44.824054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 685/1371] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 24 08:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:44.829076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ecfbf-5a8d-4669-8212-0a4637fe1fe0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:44.829597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ecfbf-5a8d-4669-8212-0a4637fe1fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:44.829597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ecfbf-5a8d-4669-8212-0a4637fe1fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:44.911662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-826ecfbf-5a8d-4669-8212-0a4637fe1fe0 None None] MFA Rules not processed for user `bf830371223c4280902001e389cff3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:44.913059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-826ecfbf-5a8d-4669-8212-0a4637fe1fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:44.969545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:45.006036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 687/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 24 08:47:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:47:45.015212 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f72a31-69e6-4a13-9f1b-a9bad68f39e8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:45.017480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-33f72a31-69e6-4a13-9f1b-a9bad68f39e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:45.071616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:45.131248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f72a31-69e6-4a13-9f1b-a9bad68f39e8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:45.212366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b15399-880c-4dc8-a5d5-5433b03d1f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:45.213397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b15399-880c-4dc8-a5d5-5433b03d1f82 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:45.213807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b15399-880c-4dc8-a5d5-5433b03d1f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:45.213996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b15399-880c-4dc8-a5d5-5433b03d1f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:45.215739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a2b15399-880c-4dc8-a5d5-5433b03d1f82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:45.358267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:45.383906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b15399-880c-4dc8-a5d5-5433b03d1f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:45.386385 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b15399-880c-4dc8-a5d5-5433b03d1f82 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:45.416125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 686/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:45.443207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d107e6-199c-488f-b792-abbb3f53d544 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:45.443501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d107e6-199c-488f-b792-abbb3f53d544 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:45.443844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d107e6-199c-488f-b792-abbb3f53d544 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:45.445248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 688/1374] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:45.450508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4334-02fe-4afe-85c0-15679d2652bc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:45.450808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4334-02fe-4afe-85c0-15679d2652bc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:45.451134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e4334-02fe-4afe-85c0-15679d2652bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:45.549722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ad1e4334-02fe-4afe-85c0-15679d2652bc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:45.551696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ad1e4334-02fe-4afe-85c0-15679d2652bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:45.705788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 687/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:46.029235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d107e6-199c-488f-b792-abbb3f53d544 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:46.030835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-49d107e6-199c-488f-b792-abbb3f53d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:46.206249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d107e6-199c-488f-b792-abbb3f53d544 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:46.261786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:46.330914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a27b0b-b5c8-4599-876e-b0a20bf9c15f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:46.331450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a27b0b-b5c8-4599-876e-b0a20bf9c15f service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:46.331700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a27b0b-b5c8-4599-876e-b0a20bf9c15f service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:46.331969 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a27b0b-b5c8-4599-876e-b0a20bf9c15f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:46.333618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b8a27b0b-b5c8-4599-876e-b0a20bf9c15f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:46.430455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a27b0b-b5c8-4599-876e-b0a20bf9c15f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:46.432523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a27b0b-b5c8-4599-876e-b0a20bf9c15f service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:46.455075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 689/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:48.467394 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc361b-f4af-4e62-a7ca-6ffea026bd1c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:48.467905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc361b-f4af-4e62-a7ca-6ffea026bd1c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:48.468029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc361b-f4af-4e62-a7ca-6ffea026bd1c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:48.469364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 688/1377] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:48.474763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782705da-d9bd-4512-9ba0-43ea3665b8ce None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:48.475210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782705da-d9bd-4512-9ba0-43ea3665b8ce None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:48.475309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782705da-d9bd-4512-9ba0-43ea3665b8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:48.557822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-782705da-d9bd-4512-9ba0-43ea3665b8ce None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:48.559201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-782705da-d9bd-4512-9ba0-43ea3665b8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:48.566463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:48.686768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 690/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:48.980513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc361b-f4af-4e62-a7ca-6ffea026bd1c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:48.981704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7edc361b-f4af-4e62-a7ca-6ffea026bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:49.048844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:49.169292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc361b-f4af-4e62-a7ca-6ffea026bd1c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:49.300783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d6a15-bbac-476a-9e74-d43c5d41f4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:49.301667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6a15-bbac-476a-9e74-d43c5d41f4e7 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:49.301955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6a15-bbac-476a-9e74-d43c5d41f4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:49.302233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d6a15-bbac-476a-9e74-d43c5d41f4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:49.303879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a24d6a15-bbac-476a-9e74-d43c5d41f4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:49.324586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:49.400940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6a15-bbac-476a-9e74-d43c5d41f4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:49.402544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d6a15-bbac-476a-9e74-d43c5d41f4e7 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:49.423557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 689/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:51.433618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c62d99-e78a-452c-a2a8-7feede9cceff None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:51.434133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c62d99-e78a-452c-a2a8-7feede9cceff None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:51.434133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c62d99-e78a-452c-a2a8-7feede9cceff None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:51.436780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 691/1380] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:51.441940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c868-c109-4f05-9e05-2f1e8ff447ae None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:51.441940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c868-c109-4f05-9e05-2f1e8ff447ae None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:51.441940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9c868-c109-4f05-9e05-2f1e8ff447ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:51.509764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-19f9c868-c109-4f05-9e05-2f1e8ff447ae None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:51.510981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-19f9c868-c109-4f05-9e05-2f1e8ff447ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:51.606302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:51.613334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 690/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:51.928533 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c62d99-e78a-452c-a2a8-7feede9cceff None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:51.930762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-22c62d99-e78a-452c-a2a8-7feede9cceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:52.091127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:52.103106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c62d99-e78a-452c-a2a8-7feede9cceff None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:52.223273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179248a8-c45a-4fee-b97d-78f199c1a46c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:52.223873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179248a8-c45a-4fee-b97d-78f199c1a46c service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:52.224155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179248a8-c45a-4fee-b97d-78f199c1a46c service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:52.224451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179248a8-c45a-4fee-b97d-78f199c1a46c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:52.226032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-179248a8-c45a-4fee-b97d-78f199c1a46c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:52.321543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179248a8-c45a-4fee-b97d-78f199c1a46c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:52.323071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179248a8-c45a-4fee-b97d-78f199c1a46c service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:52.334431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:52.343739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 692/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:54.314508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde84ab4-dd84-4933-bbc9-4441acf75907 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:54.315047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde84ab4-dd84-4933-bbc9-4441acf75907 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:54.315047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde84ab4-dd84-4933-bbc9-4441acf75907 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:54.316409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 691/1383] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:47:54.321880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5604a-007d-4a31-99e7-701235c6fa98 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:54.322472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5604a-007d-4a31-99e7-701235c6fa98 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:54.322472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5604a-007d-4a31-99e7-701235c6fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:54.390897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6ae5604a-007d-4a31-99e7-701235c6fa98 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:54.392112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6ae5604a-007d-4a31-99e7-701235c6fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:54.504026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 693/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:54.790434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde84ab4-dd84-4933-bbc9-4441acf75907 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:54.791951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fde84ab4-dd84-4933-bbc9-4441acf75907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:54.938343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde84ab4-dd84-4933-bbc9-4441acf75907 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:55.007470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:55.059191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce598a10-5269-4264-a66f-67920a360c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:55.059800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce598a10-5269-4264-a66f-67920a360c45 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:55.060088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce598a10-5269-4264-a66f-67920a360c45 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:55.060569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce598a10-5269-4264-a66f-67920a360c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:55.062016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ce598a10-5269-4264-a66f-67920a360c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:55.157429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce598a10-5269-4264-a66f-67920a360c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:55.159043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce598a10-5269-4264-a66f-67920a360c45 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:55.178048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 692/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:47:57.107140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe5c9-addb-438a-952f-09a2559f73fe None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:57.107729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe5c9-addb-438a-952f-09a2559f73fe None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:57.107729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe5c9-addb-438a-952f-09a2559f73fe None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:57.109579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 694/1386] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:47:57.115200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bb091-8864-48c5-9af0-4f182a8e7a13 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:57.115638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bb091-8864-48c5-9af0-4f182a8e7a13 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:57.115784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bb091-8864-48c5-9af0-4f182a8e7a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:57.189835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8e1bb091-8864-48c5-9af0-4f182a8e7a13 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:47:57.191608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8e1bb091-8864-48c5-9af0-4f182a8e7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:57.230309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:57.295046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 693/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:47:57.587174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fe5c9-addb-438a-952f-09a2559f73fe None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:47:57.588850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0b1fe5c9-addb-438a-952f-09a2559f73fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:57.685375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:57.765777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fe5c9-addb-438a-952f-09a2559f73fe None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:47:57.895475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7de3ca-a2c5-4be3-bc05-edc08014325e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:47:57.896008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7de3ca-a2c5-4be3-bc05-edc08014325e service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:47:57.896291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7de3ca-a2c5-4be3-bc05-edc08014325e service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:47:57.896595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7de3ca-a2c5-4be3-bc05-edc08014325e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:47:57.898298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1c7de3ca-a2c5-4be3-bc05-edc08014325e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:47:57.944848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:47:58.005514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7de3ca-a2c5-4be3-bc05-edc08014325e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:47:58.007380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7de3ca-a2c5-4be3-bc05-edc08014325e service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:47:58.027686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 695/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:00.088086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f329e8-2a8e-4a2d-897f-efa2b7b37ad5 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:00.088666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f329e8-2a8e-4a2d-897f-efa2b7b37ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:00.088666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f329e8-2a8e-4a2d-897f-efa2b7b37ad5 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:00.090158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 694/1389] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:00.095792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcad326-78fd-4148-8dfc-51f11debbd9b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:00.096214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcad326-78fd-4148-8dfc-51f11debbd9b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:00.096347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcad326-78fd-4148-8dfc-51f11debbd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:00.161538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8bcad326-78fd-4148-8dfc-51f11debbd9b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:00.162738 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8bcad326-78fd-4148-8dfc-51f11debbd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:00.258608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 696/1390] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:00.547016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f329e8-2a8e-4a2d-897f-efa2b7b37ad5 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:00.548777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d3f329e8-2a8e-4a2d-897f-efa2b7b37ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:00.693552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce414-d1af-4f36-bb04-1f866e585333 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:00.693841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce414-d1af-4f36-bb04-1f866e585333 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:00.694121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ce414-d1af-4f36-bb04-1f866e585333 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:00.695465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 697/1391] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:48:00.695720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f329e8-2a8e-4a2d-897f-efa2b7b37ad5 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:00.706712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3970f3a-5288-435d-91d4-7e53e1e486b1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:00.707096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3970f3a-5288-435d-91d4-7e53e1e486b1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:00.707481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3970f3a-5288-435d-91d4-7e53e1e486b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:00.724479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:00.724715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:00.778147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d3970f3a-5288-435d-91d4-7e53e1e486b1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:00.779390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d3970f3a-5288-435d-91d4-7e53e1e486b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:00.824649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694f1b-0e51-44f4-9ca9-359dab82cf87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:00.825178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694f1b-0e51-44f4-9ca9-359dab82cf87 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:00.825459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694f1b-0e51-44f4-9ca9-359dab82cf87 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:00.825729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694f1b-0e51-44f4-9ca9-359dab82cf87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:00.827365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b1694f1b-0e51-44f4-9ca9-359dab82cf87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:00.880621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 698/1392] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:00.915785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1694f1b-0e51-44f4-9ca9-359dab82cf87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:00.917389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1694f1b-0e51-44f4-9ca9-359dab82cf87 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:00.935192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 695/1393] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:01.184414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c0ae6-61a9-447e-a759-605b47674eba None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:01.184873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c0ae6-61a9-447e-a759-605b47674eba None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:01.184987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c0ae6-61a9-447e-a759-605b47674eba None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:01.186312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 699/1394] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 24 08:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:01.191854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1508-6337-4c8b-a30f-a751206d58b9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:01.192264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1508-6337-4c8b-a30f-a751206d58b9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:01.192445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa1508-6337-4c8b-a30f-a751206d58b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:01.217738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:01.271321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-77aa1508-6337-4c8b-a30f-a751206d58b9 None None] MFA Rules not processed for user `d8a1ec98c3264279822a7b46fc20ac94`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:01.272643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-77aa1508-6337-4c8b-a30f-a751206d58b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:01.349345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 696/1395] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 24 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:01.356604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c0ae6-61a9-447e-a759-605b47674eba None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:01.358142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-be6c0ae6-61a9-447e-a759-605b47674eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:01.459628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:01.467006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c0ae6-61a9-447e-a759-605b47674eba None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:01.540065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f2f7b9-a5fa-4602-b91a-feb066d1b451 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a1ec98c3264279822a7b46fc20ac94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:01.540694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f7b9-a5fa-4602-b91a-feb066d1b451 service glance] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:01.540968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f7b9-a5fa-4602-b91a-feb066d1b451 service glance] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:01.541236 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2f7b9-a5fa-4602-b91a-feb066d1b451 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:01.542798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f6f2f7b9-a5fa-4602-b91a-feb066d1b451 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:01.654624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2f7b9-a5fa-4602-b91a-feb066d1b451 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:01.656095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f2f7b9-a5fa-4602-b91a-feb066d1b451 service glance] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:01.675625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 700/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:02.435148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3c145-aff2-42fa-b5e2-856562d65f01 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:02.435663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3c145-aff2-42fa-b5e2-856562d65f01 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:02.435765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3c145-aff2-42fa-b5e2-856562d65f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:02.503218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-25b3c145-aff2-42fa-b5e2-856562d65f01 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:02.504490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-25b3c145-aff2-42fa-b5e2-856562d65f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:02.563975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:02.595058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 697/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:02.638008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82c36-e559-49ed-95e8-d729e41ec94f None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:02.638483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82c36-e559-49ed-95e8-d729e41ec94f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:02.638597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd82c36-e559-49ed-95e8-d729e41ec94f None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:02.640035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 701/1398] 10.222.0.42 () {54 vars in 943 bytes} [Wed Aug 24 08:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:02.646765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699da1-180c-4605-a558-9742869358de None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:02.647086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699da1-180c-4605-a558-9742869358de None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:02.647368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49699da1-180c-4605-a558-9742869358de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:02.723622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-49699da1-180c-4605-a558-9742869358de None None] MFA Rules not processed for user `7bb73a7c308340f48fc0106e96de3f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:02.724786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-49699da1-180c-4605-a558-9742869358de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:02.831477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 698/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Wed Aug 24 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:02.841076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82c36-e559-49ed-95e8-d729e41ec94f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:02.842574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5dd82c36-e559-49ed-95e8-d729e41ec94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:02.865581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:02.882990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00f91-6740-4d60-8b83-2c22a5908b1a None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:02.883286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00f91-6740-4d60-8b83-2c22a5908b1a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:02.883567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00f91-6740-4d60-8b83-2c22a5908b1a None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:02.884936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 699/1400] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:48:02.890613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:02.890901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:02.891179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:02.936165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:02.957919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:02.959134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:02.979926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd82c36-e559-49ed-95e8-d729e41ec94f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:03.057086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 700/1401] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:03.084735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaa05a-14e7-4fc4-beda-3bddac04a3b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:03.085345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa05a-14e7-4fc4-beda-3bddac04a3b7 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:03.085640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa05a-14e7-4fc4-beda-3bddac04a3b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:03.085899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaa05a-14e7-4fc4-beda-3bddac04a3b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:03.087515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78aaa05a-14e7-4fc4-beda-3bddac04a3b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:03.094634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:03.169751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaa05a-14e7-4fc4-beda-3bddac04a3b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:03.171891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaa05a-14e7-4fc4-beda-3bddac04a3b7 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:03.180127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 702/1402] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:48:03.350985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:03.352186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:03.476000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686ee74-b5e9-4ec1-85f1-cd55ce7db3ee None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:03.480436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:03.606601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1883d1-ea43-40f2-8b55-0e7ad1b80978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:03.607222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1883d1-ea43-40f2-8b55-0e7ad1b80978 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:03.607506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1883d1-ea43-40f2-8b55-0e7ad1b80978 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:03.607783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1883d1-ea43-40f2-8b55-0e7ad1b80978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:03.609488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-da1883d1-ea43-40f2-8b55-0e7ad1b80978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:03.713295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1883d1-ea43-40f2-8b55-0e7ad1b80978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:03.714320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1883d1-ea43-40f2-8b55-0e7ad1b80978 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:03.734461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 701/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:05.717361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fa8d6-0486-4d4b-9f0c-1642534b06eb None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:05.718438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fa8d6-0486-4d4b-9f0c-1642534b06eb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:05.718438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fa8d6-0486-4d4b-9f0c-1642534b06eb None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:05.719678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 703/1404] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:05.725090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a44ec-a78a-45d0-8ecb-7bf1b4f3dac8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:05.725575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a44ec-a78a-45d0-8ecb-7bf1b4f3dac8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:05.725682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a44ec-a78a-45d0-8ecb-7bf1b4f3dac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:05.737166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:05.797506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bc7a44ec-a78a-45d0-8ecb-7bf1b4f3dac8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:05.798752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bc7a44ec-a78a-45d0-8ecb-7bf1b4f3dac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:05.904443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 702/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:06.196023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fa8d6-0486-4d4b-9f0c-1642534b06eb None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:06.197657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-739fa8d6-0486-4d4b-9f0c-1642534b06eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:06.358307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fa8d6-0486-4d4b-9f0c-1642534b06eb None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:06.361408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:06.482045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93520a04-893e-449e-9421-38468dc8f25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:06.485082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520a04-893e-449e-9421-38468dc8f25a service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:06.485366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520a04-893e-449e-9421-38468dc8f25a service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:06.485638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93520a04-893e-449e-9421-38468dc8f25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:06.487495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-93520a04-893e-449e-9421-38468dc8f25a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:06.588211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93520a04-893e-449e-9421-38468dc8f25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:06.589872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93520a04-893e-449e-9421-38468dc8f25a service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:06.609093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 704/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:08.572318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505d35-f9c5-47f4-b94e-cbf2708c4a2e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:08.572941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505d35-f9c5-47f4-b94e-cbf2708c4a2e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:08.573215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505d35-f9c5-47f4-b94e-cbf2708c4a2e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:08.574812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 703/1407] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:08.587833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680bb69-d730-48f0-9be2-f1bef79a1ea0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:08.588917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680bb69-d730-48f0-9be2-f1bef79a1ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:08.589411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680bb69-d730-48f0-9be2-f1bef79a1ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:08.599960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:08.664246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a680bb69-d730-48f0-9be2-f1bef79a1ea0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:08.665569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a680bb69-d730-48f0-9be2-f1bef79a1ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:08.775834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 705/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:09.073848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43505d35-f9c5-47f4-b94e-cbf2708c4a2e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:09.075224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-43505d35-f9c5-47f4-b94e-cbf2708c4a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:09.243833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:09.321284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43505d35-f9c5-47f4-b94e-cbf2708c4a2e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:09.452252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ac233-3e74-4253-888c-41f73e4a2cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:09.452806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac233-3e74-4253-888c-41f73e4a2cf0 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:09.453094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac233-3e74-4253-888c-41f73e4a2cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:09.453384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ac233-3e74-4253-888c-41f73e4a2cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:09.455007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3e3ac233-3e74-4253-888c-41f73e4a2cf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:09.514453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:09.565907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ac233-3e74-4253-888c-41f73e4a2cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:09.567705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ac233-3e74-4253-888c-41f73e4a2cf0 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:09.595646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 704/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:18.772833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=62 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:19.592325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=23 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:25.296567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0088d7-dea9-4cb3-b3d7-78f3380bce69 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:25.297142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0088d7-dea9-4cb3-b3d7-78f3380bce69 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:25.297142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0088d7-dea9-4cb3-b3d7-78f3380bce69 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:25.298502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 706/1410] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 24 08:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:25.303830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e05be7-183e-4f52-9994-14cc8ba42a47 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:25.304230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e05be7-183e-4f52-9994-14cc8ba42a47 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:25.304411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e05be7-183e-4f52-9994-14cc8ba42a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:25.380524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a8e05be7-183e-4f52-9994-14cc8ba42a47 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:25.381750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a8e05be7-183e-4f52-9994-14cc8ba42a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:25.489428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 705/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:25.504400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faceecb-cdd9-4f09-bd68-0a014c0be184 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:25.504722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faceecb-cdd9-4f09-bd68-0a014c0be184 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:25.505019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faceecb-cdd9-4f09-bd68-0a014c0be184 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:25.506638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 707/1412] 10.222.0.42 () {54 vars in 918 bytes} [Wed Aug 24 08:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:25.511278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de556e8-3aa5-4178-b3bf-22e3ffedcdb8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:25.511590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de556e8-3aa5-4178-b3bf-22e3ffedcdb8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:25.511864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de556e8-3aa5-4178-b3bf-22e3ffedcdb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:25.583162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:25.586074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3de556e8-3aa5-4178-b3bf-22e3ffedcdb8 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:25.587883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3de556e8-3aa5-4178-b3bf-22e3ffedcdb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:25.701502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 706/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Wed Aug 24 08:48:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:48:28.088855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0f94-80b4-4660-b1c3-ec65bc9f0e34 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:28.089489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0f94-80b4-4660-b1c3-ec65bc9f0e34 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:28.089489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0f94-80b4-4660-b1c3-ec65bc9f0e34 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:28.090757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:28.096803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a04a7-580f-44ce-8840-3948bf8760e1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:28.097253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a04a7-580f-44ce-8840-3948bf8760e1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:28.097358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a04a7-580f-44ce-8840-3948bf8760e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:28.161932 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-423a04a7-580f-44ce-8840-3948bf8760e1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:28.163147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-423a04a7-580f-44ce-8840-3948bf8760e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:28.217042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:28.259794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:28.542910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf0f94-80b4-4660-b1c3-ec65bc9f0e34 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:28.545199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7caf0f94-80b4-4660-b1c3-ec65bc9f0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:28.694479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf0f94-80b4-4660-b1c3-ec65bc9f0e34 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:28.768245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:28.808574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ded9-3f4c-473e-9997-78f21fff405d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:28.809153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ded9-3f4c-473e-9997-78f21fff405d service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:28.809436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ded9-3f4c-473e-9997-78f21fff405d service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:28.809745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ded9-3f4c-473e-9997-78f21fff405d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:28.811381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-af66ded9-3f4c-473e-9997-78f21fff405d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:28.898968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ded9-3f4c-473e-9997-78f21fff405d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:28.900621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ded9-3f4c-473e-9997-78f21fff405d service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:28.918809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 709/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:29.807130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44049abb-66df-43c6-bf4c-2e7577c42305 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:29.807645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44049abb-66df-43c6-bf4c-2e7577c42305 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:29.807645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44049abb-66df-43c6-bf4c-2e7577c42305 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:29.809020 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:29.813870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491f8aa-7196-413a-a0df-cfddb337ca0b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:29.814297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491f8aa-7196-413a-a0df-cfddb337ca0b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:29.814421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491f8aa-7196-413a-a0df-cfddb337ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:29.890137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0491f8aa-7196-413a-a0df-cfddb337ca0b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:29.891337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0491f8aa-7196-413a-a0df-cfddb337ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:29.917804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:29.985967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:30.138981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44049abb-66df-43c6-bf4c-2e7577c42305 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:30.140410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-44049abb-66df-43c6-bf4c-2e7577c42305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:30.285144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44049abb-66df-43c6-bf4c-2e7577c42305 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:30.324046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:30.396166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316f721-97c0-4c18-92cf-390342c34800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:30.396983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316f721-97c0-4c18-92cf-390342c34800 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:30.397267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316f721-97c0-4c18-92cf-390342c34800 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:30.397544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316f721-97c0-4c18-92cf-390342c34800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:30.399145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9316f721-97c0-4c18-92cf-390342c34800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:30.487334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316f721-97c0-4c18-92cf-390342c34800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:30.489052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316f721-97c0-4c18-92cf-390342c34800 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:30.507361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 709/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:31.387474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8498f-7e78-4e36-957b-4b8b29cd3c0a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:31.388650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8498f-7e78-4e36-957b-4b8b29cd3c0a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:31.388761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8498f-7e78-4e36-957b-4b8b29cd3c0a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:31.390158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:31.395262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f0ee-9aa2-446a-8d16-9827b015d4ab None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:31.395677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f0ee-9aa2-446a-8d16-9827b015d4ab None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:31.395821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f0ee-9aa2-446a-8d16-9827b015d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:31.450149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:31.472456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2d91f0ee-9aa2-446a-8d16-9827b015d4ab None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:31.473687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d91f0ee-9aa2-446a-8d16-9827b015d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:31.569272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:31.724155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8498f-7e78-4e36-957b-4b8b29cd3c0a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:31.725765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8bb8498f-7e78-4e36-957b-4b8b29cd3c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:31.870231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8498f-7e78-4e36-957b-4b8b29cd3c0a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:31.882389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:31.984291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28116c3-8be2-4cee-b902-cb589dab4539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:31.984843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28116c3-8be2-4cee-b902-cb589dab4539 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:31.985126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28116c3-8be2-4cee-b902-cb589dab4539 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:31.985414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28116c3-8be2-4cee-b902-cb589dab4539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:31.986987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a28116c3-8be2-4cee-b902-cb589dab4539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:32.074612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28116c3-8be2-4cee-b902-cb589dab4539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:32.076300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28116c3-8be2-4cee-b902-cb589dab4539 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:32.094613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 712/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:32.960091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45c53-799f-42e6-9a25-ae272bb95bb7 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:32.960888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45c53-799f-42e6-9a25-ae272bb95bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:32.960888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45c53-799f-42e6-9a25-ae272bb95bb7 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:32.962049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:32.967017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b9e8a-f27b-4306-b4e4-88f61c22bde0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:32.967432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b9e8a-f27b-4306-b4e4-88f61c22bde0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:32.967552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b9e8a-f27b-4306-b4e4-88f61c22bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:32.987281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:33.043610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0e8b9e8a-f27b-4306-b4e4-88f61c22bde0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:33.045363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0e8b9e8a-f27b-4306-b4e4-88f61c22bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:33.141395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:33.292835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45c53-799f-42e6-9a25-ae272bb95bb7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:33.294424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-70d45c53-799f-42e6-9a25-ae272bb95bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:33.405239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:33.440338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45c53-799f-42e6-9a25-ae272bb95bb7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:33.555809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4470a-2ed6-42a0-b48b-79f4a3f51d7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:33.556334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4470a-2ed6-42a0-b48b-79f4a3f51d7c service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:33.556638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4470a-2ed6-42a0-b48b-79f4a3f51d7c service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:33.556908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4470a-2ed6-42a0-b48b-79f4a3f51d7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:33.558494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e3b4470a-2ed6-42a0-b48b-79f4a3f51d7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:33.634773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:33.648996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4470a-2ed6-42a0-b48b-79f4a3f51d7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:33.650601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4470a-2ed6-42a0-b48b-79f4a3f51d7c service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:33.668623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 712/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:34.515956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97267ae4-9050-40cf-a830-e5fbb88be4fd None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:34.516515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97267ae4-9050-40cf-a830-e5fbb88be4fd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:34.516515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97267ae4-9050-40cf-a830-e5fbb88be4fd None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:34.517863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:34.522671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c39c90-f57d-46f6-9386-765435ca5031 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:34.523082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c39c90-f57d-46f6-9386-765435ca5031 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:34.523234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c39c90-f57d-46f6-9386-765435ca5031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:34.598927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-89c39c90-f57d-46f6-9386-765435ca5031 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:34.600123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-89c39c90-f57d-46f6-9386-765435ca5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:34.693842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:34.845106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97267ae4-9050-40cf-a830-e5fbb88be4fd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:34.846593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-97267ae4-9050-40cf-a830-e5fbb88be4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:34.930098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:34.994962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97267ae4-9050-40cf-a830-e5fbb88be4fd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:35.110482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67149c9e-41c5-4fc1-b126-319c5fcf9df0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:35.111015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149c9e-41c5-4fc1-b126-319c5fcf9df0 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:35.111289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149c9e-41c5-4fc1-b126-319c5fcf9df0 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:35.111558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67149c9e-41c5-4fc1-b126-319c5fcf9df0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:35.113252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-67149c9e-41c5-4fc1-b126-319c5fcf9df0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:35.160691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:35.203107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67149c9e-41c5-4fc1-b126-319c5fcf9df0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:35.204760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67149c9e-41c5-4fc1-b126-319c5fcf9df0 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:35.223195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 715/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:36.028793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5327-bc52-4fbf-b24d-0edbe35f39fc None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:36.029447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5327-bc52-4fbf-b24d-0edbe35f39fc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:36.029447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5327-bc52-4fbf-b24d-0edbe35f39fc None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:36.030685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:36.035510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e79a-1cdd-4231-8eba-7702c2c4fd26 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:36.035954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e79a-1cdd-4231-8eba-7702c2c4fd26 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:36.036091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e79a-1cdd-4231-8eba-7702c2c4fd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:36.110858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9f09e79a-1cdd-4231-8eba-7702c2c4fd26 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:36.112051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9f09e79a-1cdd-4231-8eba-7702c2c4fd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:36.210004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:36.361641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c5327-bc52-4fbf-b24d-0edbe35f39fc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:36.363072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ae4c5327-bc52-4fbf-b24d-0edbe35f39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:36.412282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:36.508088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c5327-bc52-4fbf-b24d-0edbe35f39fc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:36.617336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2efd05-7888-43a4-9711-02c189761f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:36.617870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd05-7888-43a4-9711-02c189761f55 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:36.618148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd05-7888-43a4-9711-02c189761f55 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:36.618419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2efd05-7888-43a4-9711-02c189761f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:36.619996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3d2efd05-7888-43a4-9711-02c189761f55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:36.627265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:36.707536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2efd05-7888-43a4-9711-02c189761f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:36.709163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2efd05-7888-43a4-9711-02c189761f55 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:36.726280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 715/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:37.529684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb888f-56e0-417e-b0b8-1158cf9471b4 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:37.530809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb888f-56e0-417e-b0b8-1158cf9471b4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:37.530921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb888f-56e0-417e-b0b8-1158cf9471b4 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:37.532248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:37.537655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08069525-c268-4cfa-bc89-4ebfaa05bb6f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:37.538105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08069525-c268-4cfa-bc89-4ebfaa05bb6f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:37.538224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08069525-c268-4cfa-bc89-4ebfaa05bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:37.627711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-08069525-c268-4cfa-bc89-4ebfaa05bb6f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:37.628957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-08069525-c268-4cfa-bc89-4ebfaa05bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:37.695551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:37.724932 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:37.877067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb888f-56e0-417e-b0b8-1158cf9471b4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:37.879299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0eeb888f-56e0-417e-b0b8-1158cf9471b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:37.898739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:38.028658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb888f-56e0-417e-b0b8-1158cf9471b4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:38.116788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:38.145461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41be3-a92a-460d-99de-25ce16c67b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:38.146115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41be3-a92a-460d-99de-25ce16c67b57 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:38.146415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41be3-a92a-460d-99de-25ce16c67b57 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:38.146706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41be3-a92a-460d-99de-25ce16c67b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:38.148428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a3c41be3-a92a-460d-99de-25ce16c67b57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:38.243415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c41be3-a92a-460d-99de-25ce16c67b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:38.245174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c41be3-a92a-460d-99de-25ce16c67b57 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:38.264728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 718/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:39.072101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17903-fd78-44fb-b22c-b5aead99fcee None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:39.072699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17903-fd78-44fb-b22c-b5aead99fcee None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:39.072699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad17903-fd78-44fb-b22c-b5aead99fcee None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:39.074027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:39.079649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25651c-b1af-434c-b029-515fb49ef631 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:39.080069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25651c-b1af-434c-b029-515fb49ef631 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:39.080287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25651c-b1af-434c-b029-515fb49ef631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:39.158156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7c25651c-b1af-434c-b029-515fb49ef631 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:39.159376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7c25651c-b1af-434c-b029-515fb49ef631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:39.200536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:39.255166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:39.406251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17903-fd78-44fb-b22c-b5aead99fcee None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:39.407684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2ad17903-fd78-44fb-b22c-b5aead99fcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:39.549629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad17903-fd78-44fb-b22c-b5aead99fcee None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:39.611313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:39.669040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c2b08-a69d-4a9e-b287-9d1b8e0dd0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:39.669644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2b08-a69d-4a9e-b287-9d1b8e0dd0a7 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:39.669923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2b08-a69d-4a9e-b287-9d1b8e0dd0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:39.670191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c2b08-a69d-4a9e-b287-9d1b8e0dd0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:39.671760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fc4c2b08-a69d-4a9e-b287-9d1b8e0dd0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:39.757229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2b08-a69d-4a9e-b287-9d1b8e0dd0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:39.758805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c2b08-a69d-4a9e-b287-9d1b8e0dd0a7 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:39.776484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 718/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:40.594081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9e779-c63e-48a3-a159-fc57d3d9a40d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:40.594548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9e779-c63e-48a3-a159-fc57d3d9a40d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:40.594679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9e779-c63e-48a3-a159-fc57d3d9a40d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:40.595992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:40.601048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0687df-6055-4221-aa63-ed5fb5014ea6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:40.601486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0687df-6055-4221-aa63-ed5fb5014ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:40.601591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0687df-6055-4221-aa63-ed5fb5014ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:40.677781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ca0687df-6055-4221-aa63-ed5fb5014ea6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:40.679091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ca0687df-6055-4221-aa63-ed5fb5014ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:40.681292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:40.774830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:40.929277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9e779-c63e-48a3-a159-fc57d3d9a40d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:40.930831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-22c9e779-c63e-48a3-a159-fc57d3d9a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:41.076251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9e779-c63e-48a3-a159-fc57d3d9a40d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:41.104456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:41.192025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425dc76-f4e8-46ec-83ee-061afa955e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:41.192583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425dc76-f4e8-46ec-83ee-061afa955e04 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:41.192870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425dc76-f4e8-46ec-83ee-061afa955e04 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:41.193172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425dc76-f4e8-46ec-83ee-061afa955e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:41.194775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d425dc76-f4e8-46ec-83ee-061afa955e04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:41.285489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425dc76-f4e8-46ec-83ee-061afa955e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:41.287099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425dc76-f4e8-46ec-83ee-061afa955e04 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:41.305331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 721/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:43.137152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461faa0-f014-479f-813e-10c4268e7f27 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:43.137724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461faa0-f014-479f-813e-10c4268e7f27 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:43.137724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461faa0-f014-479f-813e-10c4268e7f27 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:43.139038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:43.144347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07c01-c559-43ba-a051-eff1f6f9580f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:43.144772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07c01-c559-43ba-a051-eff1f6f9580f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:43.144932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f07c01-c559-43ba-a051-eff1f6f9580f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:43.185727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:43.210316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-51f07c01-c559-43ba-a051-eff1f6f9580f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:43.211517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-51f07c01-c559-43ba-a051-eff1f6f9580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:43.305375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:43.585222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461faa0-f014-479f-813e-10c4268e7f27 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:43.586763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4461faa0-f014-479f-813e-10c4268e7f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:43.692069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461faa0-f014-479f-813e-10c4268e7f27 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:43.723362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:43.765223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5260a1a-99cd-43c6-8260-dd25f979d270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:43.766092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260a1a-99cd-43c6-8260-dd25f979d270 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:43.766369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260a1a-99cd-43c6-8260-dd25f979d270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:43.766646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260a1a-99cd-43c6-8260-dd25f979d270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:43.768243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a5260a1a-99cd-43c6-8260-dd25f979d270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:43.876396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5260a1a-99cd-43c6-8260-dd25f979d270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:43.877854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5260a1a-99cd-43c6-8260-dd25f979d270 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:43.896805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 721/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:46.024899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5988-56fa-46d7-bcde-48ea1dac4275 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:46.025463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5988-56fa-46d7-bcde-48ea1dac4275 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:46.025463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f5988-56fa-46d7-bcde-48ea1dac4275 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:46.026835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:46.032717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa172-68da-436d-af1a-23b5f2accf85 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:46.033122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa172-68da-436d-af1a-23b5f2accf85 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:46.033297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa172-68da-436d-af1a-23b5f2accf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:46.101081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3adfa172-68da-436d-af1a-23b5f2accf85 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:46.102283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3adfa172-68da-436d-af1a-23b5f2accf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:46.115304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:46.200502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:46.484378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f5988-56fa-46d7-bcde-48ea1dac4275 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:46.485981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-303f5988-56fa-46d7-bcde-48ea1dac4275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:46.590217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f5988-56fa-46d7-bcde-48ea1dac4275 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:46.602549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:46.665098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa9a6f-df7e-4b09-90ab-c0b888228139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:46.665705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9a6f-df7e-4b09-90ab-c0b888228139 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:46.665984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9a6f-df7e-4b09-90ab-c0b888228139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:46.666258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa9a6f-df7e-4b09-90ab-c0b888228139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:46.667856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-00aa9a6f-df7e-4b09-90ab-c0b888228139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:46.776270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa9a6f-df7e-4b09-90ab-c0b888228139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:46.778223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa9a6f-df7e-4b09-90ab-c0b888228139 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:46.796486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 724/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:48.993814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b109e-0aea-4d45-9d09-f75173292562 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:48.994382 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b109e-0aea-4d45-9d09-f75173292562 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:48.994382 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b109e-0aea-4d45-9d09-f75173292562 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:48.995762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:49.002074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d34b5f-73ca-4a1e-8fcc-e1007c5d3ab9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:49.002495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d34b5f-73ca-4a1e-8fcc-e1007c5d3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:49.002627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d34b5f-73ca-4a1e-8fcc-e1007c5d3ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:49.049928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:49.067051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b1d34b5f-73ca-4a1e-8fcc-e1007c5d3ab9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:49.068242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b1d34b5f-73ca-4a1e-8fcc-e1007c5d3ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:49.162721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:49.442980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b109e-0aea-4d45-9d09-f75173292562 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:49.444541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-521b109e-0aea-4d45-9d09-f75173292562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:49.546134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b109e-0aea-4d45-9d09-f75173292562 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:49.587546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:49.622490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05483a4-aacf-4dcc-a71f-9b4a19bc87bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:49.623129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05483a4-aacf-4dcc-a71f-9b4a19bc87bd service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:49.623412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05483a4-aacf-4dcc-a71f-9b4a19bc87bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:49.623688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05483a4-aacf-4dcc-a71f-9b4a19bc87bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:49.625333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e05483a4-aacf-4dcc-a71f-9b4a19bc87bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:49.736640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05483a4-aacf-4dcc-a71f-9b4a19bc87bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:49.738000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05483a4-aacf-4dcc-a71f-9b4a19bc87bd service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:49.756665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 724/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:51.770927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0e49-5864-4e81-9a97-b190685d8a3b None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:51.771474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0e49-5864-4e81-9a97-b190685d8a3b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:51.771474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb0e49-5864-4e81-9a97-b190685d8a3b None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:51.772800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:51.778626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e9de-aea7-4c42-a330-e764fc64d8a8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:51.779068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e9de-aea7-4c42-a330-e764fc64d8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:51.779165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e9de-aea7-4c42-a330-e764fc64d8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:51.846056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5149e9de-aea7-4c42-a330-e764fc64d8a8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:51.847362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5149e9de-aea7-4c42-a330-e764fc64d8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:51.867810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:51.943270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:52.228705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb0e49-5864-4e81-9a97-b190685d8a3b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:52.230881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-99eb0e49-5864-4e81-9a97-b190685d8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:52.332537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb0e49-5864-4e81-9a97-b190685d8a3b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:52.352377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:52.406669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a7e6f-b2a6-4ffe-80ae-5d461fb06c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:52.407273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a7e6f-b2a6-4ffe-80ae-5d461fb06c29 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:52.407559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a7e6f-b2a6-4ffe-80ae-5d461fb06c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:52.407830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a7e6f-b2a6-4ffe-80ae-5d461fb06c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:52.409447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-611a7e6f-b2a6-4ffe-80ae-5d461fb06c29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:52.514981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a7e6f-b2a6-4ffe-80ae-5d461fb06c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:52.516516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a7e6f-b2a6-4ffe-80ae-5d461fb06c29 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:52.533820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 727/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:54.559231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5a3d-18e6-47e6-9d62-9304ae9c5bb0 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:54.559805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5a3d-18e6-47e6-9d62-9304ae9c5bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:54.559805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5a3d-18e6-47e6-9d62-9304ae9c5bb0 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:54.561146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:54.566459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d1860-377b-45fa-bbc4-25cdd45d0d81 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:54.566888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d1860-377b-45fa-bbc4-25cdd45d0d81 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:54.567046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d1860-377b-45fa-bbc4-25cdd45d0d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:54.631307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:54.634106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-139d1860-377b-45fa-bbc4-25cdd45d0d81 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:54.635910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-139d1860-377b-45fa-bbc4-25cdd45d0d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:54.731386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:48:55.013832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5a3d-18e6-47e6-9d62-9304ae9c5bb0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:55.015389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a58b5a3d-18e6-47e6-9d62-9304ae9c5bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:55.117228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5a3d-18e6-47e6-9d62-9304ae9c5bb0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:55.164948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:55.189552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a4b28-3f3c-4343-8a20-b6de73fa6b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:55.190167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4b28-3f3c-4343-8a20-b6de73fa6b50 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:55.190447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4b28-3f3c-4343-8a20-b6de73fa6b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:55.190720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a4b28-3f3c-4343-8a20-b6de73fa6b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:55.192304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-df2a4b28-3f3c-4343-8a20-b6de73fa6b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:55.299942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4b28-3f3c-4343-8a20-b6de73fa6b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:55.301324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a4b28-3f3c-4343-8a20-b6de73fa6b50 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:55.318690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 727/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:48:57.338747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1ad48-8820-43ac-a88a-92bdd70a1d1a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:57.339798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1ad48-8820-43ac-a88a-92bdd70a1d1a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:57.339889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1ad48-8820-43ac-a88a-92bdd70a1d1a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:57.341220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:48:57.346450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d2da-7cc3-41ff-a077-094743ed012b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:57.346840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d2da-7cc3-41ff-a077-094743ed012b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:57.347011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941d2da-7cc3-41ff-a077-094743ed012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:57.411830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e941d2da-7cc3-41ff-a077-094743ed012b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:48:57.413070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e941d2da-7cc3-41ff-a077-094743ed012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:57.441891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:57.511252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:48:57.803013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1ad48-8820-43ac-a88a-92bdd70a1d1a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:48:57.805366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dfe1ad48-8820-43ac-a88a-92bdd70a1d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:57.910336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1ad48-8820-43ac-a88a-92bdd70a1d1a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:48:57.938868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:48:57.982983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc8d97-6d63-4120-88e3-6394ba41bb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:48:57.983590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8d97-6d63-4120-88e3-6394ba41bb9a service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:48:57.983870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8d97-6d63-4120-88e3-6394ba41bb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:48:57.984140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc8d97-6d63-4120-88e3-6394ba41bb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:48:57.985749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3ddc8d97-6d63-4120-88e3-6394ba41bb9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:48:58.093087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8d97-6d63-4120-88e3-6394ba41bb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:48:58.094546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc8d97-6d63-4120-88e3-6394ba41bb9a service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:48:58.114682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 730/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:00.076130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc064e-fb8a-4f4d-8bd6-9c8e19b76d74 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:00.076737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc064e-fb8a-4f4d-8bd6-9c8e19b76d74 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:00.076737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc064e-fb8a-4f4d-8bd6-9c8e19b76d74 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:00.078052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:00.083426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4212f7-90a3-419c-925a-4146b26545ae None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:00.083837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4212f7-90a3-419c-925a-4146b26545ae None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:00.083998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4212f7-90a3-419c-925a-4146b26545ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:00.149006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cb4212f7-90a3-419c-925a-4146b26545ae None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:00.150212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cb4212f7-90a3-419c-925a-4146b26545ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:00.159011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:00.249547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:00.531841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc064e-fb8a-4f4d-8bd6-9c8e19b76d74 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:00.533399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-aefc064e-fb8a-4f4d-8bd6-9c8e19b76d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:00.635640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc064e-fb8a-4f4d-8bd6-9c8e19b76d74 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:00.689063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:00.707684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee9ef5-e573-469e-a4ff-490ab364c64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:00.708295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9ef5-e573-469e-a4ff-490ab364c64f service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:00.708604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9ef5-e573-469e-a4ff-490ab364c64f service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:00.708879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9ef5-e573-469e-a4ff-490ab364c64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:00.710459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4cee9ef5-e573-469e-a4ff-490ab364c64f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:00.821195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee9ef5-e573-469e-a4ff-490ab364c64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:00.822532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee9ef5-e573-469e-a4ff-490ab364c64f service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:00.841027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 730/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:02.787622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284195ed-b151-4199-8074-66d5a3445cf9 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:02.788178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284195ed-b151-4199-8074-66d5a3445cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:02.788178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284195ed-b151-4199-8074-66d5a3445cf9 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:02.789567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:02.795387 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680130ca-3696-432a-8f7c-eeca6b29324c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:02.795806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680130ca-3696-432a-8f7c-eeca6b29324c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:02.795949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680130ca-3696-432a-8f7c-eeca6b29324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:02.978075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-680130ca-3696-432a-8f7c-eeca6b29324c None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:02.979795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-680130ca-3696-432a-8f7c-eeca6b29324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:03.017485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:03.075960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:03.361985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284195ed-b151-4199-8074-66d5a3445cf9 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:03.363515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-284195ed-b151-4199-8074-66d5a3445cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:03.466603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284195ed-b151-4199-8074-66d5a3445cf9 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:03.503563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:03.540566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2707bf-5081-4614-b1b9-436e4a2a5a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:03.541198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2707bf-5081-4614-b1b9-436e4a2a5a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:03.541485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2707bf-5081-4614-b1b9-436e4a2a5a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:03.541778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2707bf-5081-4614-b1b9-436e4a2a5a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:03.543371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1c2707bf-5081-4614-b1b9-436e4a2a5a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:03.655578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2707bf-5081-4614-b1b9-436e4a2a5a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:03.656982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2707bf-5081-4614-b1b9-436e4a2a5a06 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:03.674543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 733/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:05.603535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb23b63-baed-43e0-88f1-e2e694badd3d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:05.603984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb23b63-baed-43e0-88f1-e2e694badd3d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:05.604080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb23b63-baed-43e0-88f1-e2e694badd3d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:05.606108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:05.611447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300674-4891-4985-8877-04cb87a0f89e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:05.611921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300674-4891-4985-8877-04cb87a0f89e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:05.612039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300674-4891-4985-8877-04cb87a0f89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:05.676151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-15300674-4891-4985-8877-04cb87a0f89e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:05.677379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-15300674-4891-4985-8877-04cb87a0f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:05.695248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:05.775281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:06.067038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb23b63-baed-43e0-88f1-e2e694badd3d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:06.068596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bcb23b63-baed-43e0-88f1-e2e694badd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:06.169130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb23b63-baed-43e0-88f1-e2e694badd3d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:06.234313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:06.241043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4c74-81bc-4d06-8d5e-3bf5d02fdaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:06.241647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4c74-81bc-4d06-8d5e-3bf5d02fdaeb service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:06.241924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4c74-81bc-4d06-8d5e-3bf5d02fdaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:06.242193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4c74-81bc-4d06-8d5e-3bf5d02fdaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:06.243766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-73ed4c74-81bc-4d06-8d5e-3bf5d02fdaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:06.351324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4c74-81bc-4d06-8d5e-3bf5d02fdaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:06.352702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4c74-81bc-4d06-8d5e-3bf5d02fdaeb service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:06.370622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 733/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:08.299769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170017fa-20d1-4f92-a71d-214e4841b1c1 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:08.300374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170017fa-20d1-4f92-a71d-214e4841b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:08.300374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170017fa-20d1-4f92-a71d-214e4841b1c1 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:08.301978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:08.307928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddddfb-31ca-426d-9b41-5bf9ba3da8a9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:08.308398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddddfb-31ca-426d-9b41-5bf9ba3da8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:08.308532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddddfb-31ca-426d-9b41-5bf9ba3da8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:08.373465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a9ddddfb-31ca-426d-9b41-5bf9ba3da8a9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:08.374650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a9ddddfb-31ca-426d-9b41-5bf9ba3da8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:08.420593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:08.468843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:08.759000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170017fa-20d1-4f92-a71d-214e4841b1c1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:08.760586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-170017fa-20d1-4f92-a71d-214e4841b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:08.866415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170017fa-20d1-4f92-a71d-214e4841b1c1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:08.913872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:08.940539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f96ad1-1b86-4000-97ac-f251b08374e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:08.941148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f96ad1-1b86-4000-97ac-f251b08374e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:08.941435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f96ad1-1b86-4000-97ac-f251b08374e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:08.941707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f96ad1-1b86-4000-97ac-f251b08374e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:08.943305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-38f96ad1-1b86-4000-97ac-f251b08374e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:09.050593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f96ad1-1b86-4000-97ac-f251b08374e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:09.052071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f96ad1-1b86-4000-97ac-f251b08374e7 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:09.070567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 736/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:49:18.467030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=22 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:19.068246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=66 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:28.521106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d7ea-ed92-4494-b653-c458f8696a10 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:28.521703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d7ea-ed92-4494-b653-c458f8696a10 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:28.521703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d7ea-ed92-4494-b653-c458f8696a10 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:28.522987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 735/1471] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:28.528169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584acc1-5e78-49e6-90a7-6d8c8416c481 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:28.528647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584acc1-5e78-49e6-90a7-6d8c8416c481 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:28.528773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584acc1-5e78-49e6-90a7-6d8c8416c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:28.598583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1584acc1-5e78-49e6-90a7-6d8c8416c481 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:28.599789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1584acc1-5e78-49e6-90a7-6d8c8416c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:28.693937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 737/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:28.989161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac579762-45d0-4171-8ff0-303e176c19be None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:28.989450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac579762-45d0-4171-8ff0-303e176c19be None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:28.989728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac579762-45d0-4171-8ff0-303e176c19be None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:28.991065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 736/1473] 10.222.0.42 () {54 vars in 967 bytes} [Wed Aug 24 08:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:28.996545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9723-3e73-4149-8c36-97a4075999c4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:28.996834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9723-3e73-4149-8c36-97a4075999c4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:28.997108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc9723-3e73-4149-8c36-97a4075999c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:29.073013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-afdc9723-3e73-4149-8c36-97a4075999c4 None None] MFA Rules not processed for user `d8a1ec98c3264279822a7b46fc20ac94`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:29.074233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-afdc9723-3e73-4149-8c36-97a4075999c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:29.095362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:29.151541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 738/1474] 10.222.0.42 () {58 vars in 1064 bytes} [Wed Aug 24 08:49:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:29.158976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac579762-45d0-4171-8ff0-303e176c19be None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:29.160599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ac579762-45d0-4171-8ff0-303e176c19be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:29.260437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac579762-45d0-4171-8ff0-303e176c19be None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:29.332155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3314e-4678-470b-af94-f325b0f169e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a1ec98c3264279822a7b46fc20ac94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:29.332778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3314e-4678-470b-af94-f325b0f169e5 service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:29.333055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3314e-4678-470b-af94-f325b0f169e5 service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:29.333323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3314e-4678-470b-af94-f325b0f169e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:29.334881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-39a3314e-4678-470b-af94-f325b0f169e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:29.386568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:29.441782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3314e-4678-470b-af94-f325b0f169e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:29.443234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3314e-4678-470b-af94-f325b0f169e5 service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:29.461425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 737/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:31.430154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96339-9fdf-4629-a135-58ee24049b49 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:31.430726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96339-9fdf-4629-a135-58ee24049b49 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:31.430726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b96339-9fdf-4629-a135-58ee24049b49 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:31.432073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 739/1476] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:31.437242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cafc7-cc3a-4c9d-bf8c-b3f83dc3defb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:31.437658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cafc7-cc3a-4c9d-bf8c-b3f83dc3defb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:31.437800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cafc7-cc3a-4c9d-bf8c-b3f83dc3defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:31.503621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b50cafc7-cc3a-4c9d-bf8c-b3f83dc3defb None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:31.504854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b50cafc7-cc3a-4c9d-bf8c-b3f83dc3defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:31.600485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 738/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:31.872625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96339-9fdf-4629-a135-58ee24049b49 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:31.874072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78b96339-9fdf-4629-a135-58ee24049b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:31.996288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b96339-9fdf-4629-a135-58ee24049b49 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:32.046023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:32.092125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbcedf-d99a-4bf6-8f7a-ee70b4d94b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:32.092762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbcedf-d99a-4bf6-8f7a-ee70b4d94b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:32.093046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbcedf-d99a-4bf6-8f7a-ee70b4d94b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:32.093314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbcedf-d99a-4bf6-8f7a-ee70b4d94b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:32.093957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbcedf-d99a-4bf6-8f7a-ee70b4d94b28 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:32.095725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-cbcbcedf-d99a-4bf6-8f7a-ee70b4d94b28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:49:32.095725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:49:32.095725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:49:32.096903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbcedf-d99a-4bf6-8f7a-ee70b4d94b28 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:32.115192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 740/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Wed Aug 24 08:49:31 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:49:34.047894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2b13-2fa8-4aec-81f6-458897e2550e None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:34.048502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2b13-2fa8-4aec-81f6-458897e2550e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:34.048502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f2b13-2fa8-4aec-81f6-458897e2550e None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:34.049784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 739/1479] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:34.055077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4eb08-dc78-42c8-b3fa-43fbc2c141c9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:34.055512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4eb08-dc78-42c8-b3fa-43fbc2c141c9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:34.055670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4eb08-dc78-42c8-b3fa-43fbc2c141c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:34.121121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-aec4eb08-dc78-42c8-b3fa-43fbc2c141c9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:34.122333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-aec4eb08-dc78-42c8-b3fa-43fbc2c141c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:34.218071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 741/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:34.514136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2b13-2fa8-4aec-81f6-458897e2550e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:34.515752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c81f2b13-2fa8-4aec-81f6-458897e2550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:34.525290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:34.662461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f2b13-2fa8-4aec-81f6-458897e2550e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:34.740144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:34.771807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5353e00-eb3d-4a97-a891-b9cea7c4cbab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:34.772338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353e00-eb3d-4a97-a891-b9cea7c4cbab service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:34.772639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353e00-eb3d-4a97-a891-b9cea7c4cbab service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:34.772904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5353e00-eb3d-4a97-a891-b9cea7c4cbab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:34.774966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a5353e00-eb3d-4a97-a891-b9cea7c4cbab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:34.861933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5353e00-eb3d-4a97-a891-b9cea7c4cbab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:34.863506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5353e00-eb3d-4a97-a891-b9cea7c4cbab service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:34.881142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 740/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:36.975256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea06c-5e97-4d96-a16c-c1b7ae4aa95a None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:36.975793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea06c-5e97-4d96-a16c-c1b7ae4aa95a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:36.975973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ea06c-5e97-4d96-a16c-c1b7ae4aa95a None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:36.977609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 742/1482] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:36.982988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183918cb-4f0c-4d68-8691-9cc621649080 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:36.983482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183918cb-4f0c-4d68-8691-9cc621649080 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:36.983587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183918cb-4f0c-4d68-8691-9cc621649080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:37.049168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-183918cb-4f0c-4d68-8691-9cc621649080 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:37.050343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-183918cb-4f0c-4d68-8691-9cc621649080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:37.096713 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:37.147437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 741/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:37.434682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea06c-5e97-4d96-a16c-c1b7ae4aa95a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:37.436231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f71ea06c-5e97-4d96-a16c-c1b7ae4aa95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:37.460481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:37.662983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ea06c-5e97-4d96-a16c-c1b7ae4aa95a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:37.736181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218279a-fcc5-4600-9466-f8e2e81442d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:37.736726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218279a-fcc5-4600-9466-f8e2e81442d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:37.737007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218279a-fcc5-4600-9466-f8e2e81442d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:37.737281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218279a-fcc5-4600-9466-f8e2e81442d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:37.738870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1218279a-fcc5-4600-9466-f8e2e81442d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:37.811515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:37.847108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218279a-fcc5-4600-9466-f8e2e81442d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:37.848586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218279a-fcc5-4600-9466-f8e2e81442d5 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:37.866681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 743/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:39.833592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb637-1bc1-410a-bd36-7f553c67c297 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:39.834168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb637-1bc1-410a-bd36-7f553c67c297 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:39.834168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3eb637-1bc1-410a-bd36-7f553c67c297 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:39.835391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 742/1485] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:39.841339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b590c5-81b0-4a63-b7ca-8406c8669564 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:39.841751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b590c5-81b0-4a63-b7ca-8406c8669564 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:39.841888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b590c5-81b0-4a63-b7ca-8406c8669564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:39.907350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-37b590c5-81b0-4a63-b7ca-8406c8669564 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:39.908639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-37b590c5-81b0-4a63-b7ca-8406c8669564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:40.002098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 744/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:40.285889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb637-1bc1-410a-bd36-7f553c67c297 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:40.287435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9a3eb637-1bc1-410a-bd36-7f553c67c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:40.392933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3eb637-1bc1-410a-bd36-7f553c67c297 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:40.461531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:40.463267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662af6d7-71fc-4d62-8553-6566bcbe5e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:40.463872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662af6d7-71fc-4d62-8553-6566bcbe5e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:40.464158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662af6d7-71fc-4d62-8553-6566bcbe5e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:40.464649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662af6d7-71fc-4d62-8553-6566bcbe5e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:40.466603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-662af6d7-71fc-4d62-8553-6566bcbe5e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:40.575789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662af6d7-71fc-4d62-8553-6566bcbe5e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:40.577175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662af6d7-71fc-4d62-8553-6566bcbe5e74 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:40.597231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 743/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:42.679132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fdd4e-1443-45a2-ade9-816a2ac268f0 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:42.679664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fdd4e-1443-45a2-ade9-816a2ac268f0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:42.679791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fdd4e-1443-45a2-ade9-816a2ac268f0 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:42.681807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 745/1488] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:42.687124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e260c-7d0a-45ee-bbac-ed82e9b54b85 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:42.687554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e260c-7d0a-45ee-bbac-ed82e9b54b85 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:42.687682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e260c-7d0a-45ee-bbac-ed82e9b54b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:42.752895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-451e260c-7d0a-45ee-bbac-ed82e9b54b85 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:42.754113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-451e260c-7d0a-45ee-bbac-ed82e9b54b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:42.806231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:42.850080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 744/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:49:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:43.141879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fdd4e-1443-45a2-ade9-816a2ac268f0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:43.143415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-417fdd4e-1443-45a2-ade9-816a2ac268f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:43.179685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:43.247561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fdd4e-1443-45a2-ade9-816a2ac268f0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:43.318783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7f360-1cce-475c-bd84-979a815ed347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:43.319385 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7f360-1cce-475c-bd84-979a815ed347 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:43.319663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7f360-1cce-475c-bd84-979a815ed347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:43.319931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7f360-1cce-475c-bd84-979a815ed347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:43.322045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e8a7f360-1cce-475c-bd84-979a815ed347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:43.401712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:43.431848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7f360-1cce-475c-bd84-979a815ed347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:43.433328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7f360-1cce-475c-bd84-979a815ed347 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:43.450766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 746/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:45.551118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283cb8-6d1b-462f-97fa-33f587d77873 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:45.551651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283cb8-6d1b-462f-97fa-33f587d77873 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:45.551651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb283cb8-6d1b-462f-97fa-33f587d77873 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:45.553023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 745/1491] 10.222.0.42 () {54 vars in 927 bytes} [Wed Aug 24 08:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:49:45.558827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fcef4-a6e2-4491-be3c-a9b32f0fc8b4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:45.559236 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fcef4-a6e2-4491-be3c-a9b32f0fc8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:45.559373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fcef4-a6e2-4491-be3c-a9b32f0fc8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:45.624676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5b7fcef4-a6e2-4491-be3c-a9b32f0fc8b4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:49:45.625866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5b7fcef4-a6e2-4491-be3c-a9b32f0fc8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:45.718644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 747/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Wed Aug 24 08:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:49:46.005781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb283cb8-6d1b-462f-97fa-33f587d77873 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:49:46.007559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb283cb8-6d1b-462f-97fa-33f587d77873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:46.111646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb283cb8-6d1b-462f-97fa-33f587d77873 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:49:46.186058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56436861-6be8-4c1e-ae65-54385fe908e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:49:46.186665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56436861-6be8-4c1e-ae65-54385fe908e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:49:46.186947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56436861-6be8-4c1e-ae65-54385fe908e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:49:46.187219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56436861-6be8-4c1e-ae65-54385fe908e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:49:46.188846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-56436861-6be8-4c1e-ae65-54385fe908e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:49:46.198199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:46.296798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56436861-6be8-4c1e-ae65-54385fe908e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:49:46.298157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56436861-6be8-4c1e-ae65-54385fe908e1 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:49:46.316202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 746/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:49:55.716860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=82 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:49:56.313943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=50 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:36.683899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:36.684481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:36.684481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:36.758162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:51:36.759853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:36.858078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 748/1494] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:51:36.866849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb2a3-e8df-4e04-85b4-80899344a848 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:36.867331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb2a3-e8df-4e04-85b4-80899344a848 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:36.867434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb2a3-e8df-4e04-85b4-80899344a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:36.941961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-652fb2a3-e8df-4e04-85b4-80899344a848 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:51:36.943163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-652fb2a3-e8df-4e04-85b4-80899344a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:37.038413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 747/1495] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:51:37.043186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:37.044411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:37.056064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071159e9-5794-4c1a-be10-cf71f84a4897 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:37.115471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:37.149039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:37.149646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:37.149922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:37.150188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:37.150832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:51:37.151118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:37.152143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:37.152143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:51:37.152143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:51:37.153066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:37.164483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 749/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:51:37.173806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb2a3-e8df-4e04-85b4-80899344a848 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:37.182794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb2a3-e8df-4e04-85b4-80899344a848 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:37.243158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:37.277466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:37.278102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:37.278397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:37.278693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:37.279347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:37.281096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING py.warnings [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:37.281096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: warnings.warn(msg) Aug 24 08:51:37.281096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: Aug 24 08:51:37.282806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:37.338961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 748/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:51:37 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:51:37.343340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:37.345399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:37.378729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773adeaa-da15-4b4e-8b0a-14e7dde6ed95 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:37.471160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:37.471761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:37.472039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:37.472310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:37.472974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:37.474001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:37.474001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:51:37.474001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:51:37.475199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:37.515828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 750/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:51:37 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:51:37.520141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:37.521701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:37.584207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d0fe9-25e2-48f9-a64c-a137f479758b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:37.673170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:37.684631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:37.685245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:37.685526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:37.685798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:37.686501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:37.687503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING py.warnings [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:37.687503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: warnings.warn(msg) Aug 24 08:51:37.687503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: Aug 24 08:51:37.689078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:37.701241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 749/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:51:37.705487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:37.707021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:37.718197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320e59c-9960-4d13-8806-d32cca0e288f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:37.743170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:37.815009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59074ddb-d63e-475a-a7fa-ccad09a7af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:37.815647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074ddb-d63e-475a-a7fa-ccad09a7af18 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:37.815930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074ddb-d63e-475a-a7fa-ccad09a7af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:37.816212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59074ddb-d63e-475a-a7fa-ccad09a7af18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:37.816892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59074ddb-d63e-475a-a7fa-ccad09a7af18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:37.817912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-59074ddb-d63e-475a-a7fa-ccad09a7af18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:37.817912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:51:37.817912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:51:37.818798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59074ddb-d63e-475a-a7fa-ccad09a7af18 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:37.831343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 751/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:51:37.835508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:37.837046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:37.870918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5b297-d7e0-4e21-9175-3b9cb8773a12 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:37.964635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc186c1-d94c-4607-98eb-8e81a078db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:37.965296 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc186c1-d94c-4607-98eb-8e81a078db41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:37.965577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc186c1-d94c-4607-98eb-8e81a078db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:37.965850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc186c1-d94c-4607-98eb-8e81a078db41 admin admin] PATH_INFO: `/v3/projects/d6908dd268be4d299997df77eb06f80e/users/3076da44bc3940308f8e7c91ec7a7940/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:37.987395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc186c1-d94c-4607-98eb-8e81a078db41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6908dd268be4d299997df77eb06f80e, user_id=3076da44bc3940308f8e7c91ec7a7940, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:37.988434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING py.warnings [None req-0dc186c1-d94c-4607-98eb-8e81a078db41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:37.988434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: warnings.warn(msg) Aug 24 08:51:37.988434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: Aug 24 08:51:37.990380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc186c1-d94c-4607-98eb-8e81a078db41 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:38.017080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 750/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:51:37 2022] PUT /identity/v3/projects/d6908dd268be4d299997df77eb06f80e/users/3076da44bc3940308f8e7c91ec7a7940/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:51:38.029116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfdc55-6621-4f59-9477-a8cca1d94f8c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:38.029425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfdc55-6621-4f59-9477-a8cca1d94f8c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:38.029708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfdc55-6621-4f59-9477-a8cca1d94f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:38.086551 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4bcfdc55-6621-4f59-9477-a8cca1d94f8c None None] MFA Rules not processed for user `3076da44bc3940308f8e7c91ec7a7940`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:51:38.087748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4bcfdc55-6621-4f59-9477-a8cca1d94f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:38.163911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 752/1502] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:51:38.177316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939502-7480-425f-bc69-d5baa54cd19f None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:38.177629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939502-7480-425f-bc69-d5baa54cd19f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:38.177913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d939502-7480-425f-bc69-d5baa54cd19f None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:38.179355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 751/1503] 10.222.0.42 () {54 vars in 964 bytes} [Wed Aug 24 08:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:51:38.184128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7580-fd92-4ddb-94b1-b273ecd521df None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:38.184445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7580-fd92-4ddb-94b1-b273ecd521df None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:38.184763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c7580-fd92-4ddb-94b1-b273ecd521df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:38.216990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:38.261804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-811c7580-fd92-4ddb-94b1-b273ecd521df None None] MFA Rules not processed for user `bf830371223c4280902001e389cff3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:51:38.263006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-811c7580-fd92-4ddb-94b1-b273ecd521df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:38.337150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 753/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Wed Aug 24 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:51:38.344929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939502-7480-425f-bc69-d5baa54cd19f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:38.346422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3d939502-7480-425f-bc69-d5baa54cd19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:38.395797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:38.448539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d939502-7480-425f-bc69-d5baa54cd19f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:38.522728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:38.523256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:38.523535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:38.523810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:38.525421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:38.623789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:38.625279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:38.628744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:38.643869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 752/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:51:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:51:38.689360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449628a-0faf-4af3-a94c-112fbd05cbfc None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:38.689654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449628a-0faf-4af3-a94c-112fbd05cbfc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:38.689932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449628a-0faf-4af3-a94c-112fbd05cbfc None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:38.691248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 754/1506] 10.222.0.42 () {52 vars in 830 bytes} [Wed Aug 24 08:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:51:38.694819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:38.696092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:38.794955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420348a-f519-4ce1-adca-4dad3831d33f service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:38.888465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:38.889120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:38.889360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:38.889652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] PATH_INFO: `/v3/users/3076da44bc3940308f8e7c91ec7a7940` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:38.901618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3076da44bc3940308f8e7c91ec7a7940)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:38.902626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING py.warnings [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:38.902626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: warnings.warn(msg) Aug 24 08:51:38.902626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: Aug 24 08:51:38.903835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:38.913790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:38.968353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3076da44bc3940308f8e7c91ec7a7940'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:38.969469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3076da44bc3940308f8e7c91ec7a7940'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:38.969900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3076da44bc3940308f8e7c91ec7a7940'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:38.983936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3076da44bc3940308f8e7c91ec7a7940'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:38.992990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3076da44bc3940308f8e7c91ec7a7940'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:39.024108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 753/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:51:38 2022] DELETE /identity/v3/users/3076da44bc3940308f8e7c91ec7a7940 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:51:39.028535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:39.029120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:39.029120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:39.084833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:51:39.085964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:39.162213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:39.175427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 755/1508] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:51:39.186294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:39.187518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:39.284542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8785e7-76d3-4abc-881e-bc7916d354c9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:39.338375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:39.358053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb836347-727e-4b05-8869-05dc803200eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:39.358667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836347-727e-4b05-8869-05dc803200eb service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:39.358952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836347-727e-4b05-8869-05dc803200eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:39.359229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836347-727e-4b05-8869-05dc803200eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:39.361457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb836347-727e-4b05-8869-05dc803200eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:39.467689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb836347-727e-4b05-8869-05dc803200eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:39.469647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb836347-727e-4b05-8869-05dc803200eb service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:39.488396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 754/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:51:39.825307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:51:39.826717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:51:39.840527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4797ac-f77a-411d-87eb-a076eecc25f0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:51:39.939778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:51:39.940438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:51:39.940723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:51:39.940995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] PATH_INFO: `/v3/projects/d6908dd268be4d299997df77eb06f80e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:51:39.951083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6908dd268be4d299997df77eb06f80e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:51:39.952131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:51:39.952131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:51:39.952131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:51:39.953373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:51:40.013490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6908dd268be4d299997df77eb06f80e', 'request_id': 'req-dc5a65fa-d185-47e8-b907-00b8e20d806f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:40.020334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6908dd268be4d299997df77eb06f80e', 'request_id': 'req-dc5a65fa-d185-47e8-b907-00b8e20d806f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:40.033660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6908dd268be4d299997df77eb06f80e', 'request_id': 'req-dc5a65fa-d185-47e8-b907-00b8e20d806f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:40.063748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] The token cache is being invalidate because project d6908dd268be4d299997df77eb06f80e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:51:40.064041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:40.064806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-dc5a65fa-d185-47e8-b907-00b8e20d806f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:51:40.066306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 756/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:51:39 2022] DELETE /identity/v3/projects/d6908dd268be4d299997df77eb06f80e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:51:49.486181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=62 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:51:50.060085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:23.191843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57653-8b08-4387-bfed-d6763ed01060 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:23.192470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57653-8b08-4387-bfed-d6763ed01060 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:23.192470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57653-8b08-4387-bfed-d6763ed01060 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:23.193834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:23.199378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d9d2-69cf-4934-9f05-489bcdf6f2a9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:23.199864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d9d2-69cf-4934-9f05-489bcdf6f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:23.199968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84d9d2-69cf-4934-9f05-489bcdf6f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:23.281168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3f84d9d2-69cf-4934-9f05-489bcdf6f2a9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:23.282383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3f84d9d2-69cf-4934-9f05-489bcdf6f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:23.390329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:23.550449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57653-8b08-4387-bfed-d6763ed01060 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:23.552709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1ed57653-8b08-4387-bfed-d6763ed01060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:23.671145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57653-8b08-4387-bfed-d6763ed01060 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:23.677166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a861fd-a45d-405c-87dc-f842ddb3b0a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:23.677775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a861fd-a45d-405c-87dc-f842ddb3b0a1 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:23.678055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a861fd-a45d-405c-87dc-f842ddb3b0a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:23.678326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a861fd-a45d-405c-87dc-f842ddb3b0a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:23.688843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a861fd-a45d-405c-87dc-f842ddb3b0a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:23.690941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a861fd-a45d-405c-87dc-f842ddb3b0a1 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:23.703028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 756/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:53:24.324114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069e7b-1a5c-49dc-803f-040ec9c9459c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:24.324707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069e7b-1a5c-49dc-803f-040ec9c9459c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:24.324707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4069e7b-1a5c-49dc-803f-040ec9c9459c None None] PATH_INFO: `/v3` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:24.326060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 758/1514] 10.222.0.71 () {54 vars in 925 bytes} [Wed Aug 24 08:53:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:53:24.337315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13277-658d-4086-9642-fdb1504d91c6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:24.337737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13277-658d-4086-9642-fdb1504d91c6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:24.338041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f13277-658d-4086-9642-fdb1504d91c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:24.402644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f0f13277-658d-4086-9642-fdb1504d91c6 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:24.404217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f0f13277-658d-4086-9642-fdb1504d91c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:24.481974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:24.487798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 757/1515] 10.222.0.71 () {58 vars in 1015 bytes} [Wed Aug 24 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:24.540526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14958-e5e9-4353-a2bb-8a9f5a8ab0ee None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:24.541064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14958-e5e9-4353-a2bb-8a9f5a8ab0ee None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:24.541839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b14958-e5e9-4353-a2bb-8a9f5a8ab0ee None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:24.543282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 759/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:24.548500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103016e-e243-42b6-9817-c6785b874526 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:24.548792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103016e-e243-42b6-9817-c6785b874526 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:24.549179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103016e-e243-42b6-9817-c6785b874526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:24.569670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9103016e-e243-42b6-9817-c6785b874526 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:24.570890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9103016e-e243-42b6-9817-c6785b874526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:24.579646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:24.735680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14958-e5e9-4353-a2bb-8a9f5a8ab0ee None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:24.752181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b14958-e5e9-4353-a2bb-8a9f5a8ab0ee None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:24.757583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8a71-2c77-40fd-9bdb-04369fe5aac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:24.758188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8a71-2c77-40fd-9bdb-04369fe5aac7 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:24.758471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8a71-2c77-40fd-9bdb-04369fe5aac7 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:24.758747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8a71-2c77-40fd-9bdb-04369fe5aac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:24.768605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b8a71-2c77-40fd-9bdb-04369fe5aac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:24.770636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b8a71-2c77-40fd-9bdb-04369fe5aac7 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:24.780258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 760/1518] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:53:33.486753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2877-aad9-48cd-b9ef-1eff66d8b79d None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:33.487316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2877-aad9-48cd-b9ef-1eff66d8b79d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:33.487316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a2877-aad9-48cd-b9ef-1eff66d8b79d None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:33.488727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 759/1519] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 24 08:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:33.495107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e7cba-9d64-4a04-8684-882c9b5afe09 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:33.495588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e7cba-9d64-4a04-8684-882c9b5afe09 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:33.495787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e7cba-9d64-4a04-8684-882c9b5afe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:33.515411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d82e7cba-9d64-4a04-8684-882c9b5afe09 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:33.516659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d82e7cba-9d64-4a04-8684-882c9b5afe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:33.525917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 761/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 24 08:53:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:33.533428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a2877-aad9-48cd-b9ef-1eff66d8b79d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:33.547158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a2877-aad9-48cd-b9ef-1eff66d8b79d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:33.552110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddc9d6-e858-45e0-a6a7-1bf00f1eb239 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:33.552735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddc9d6-e858-45e0-a6a7-1bf00f1eb239 service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:33.553016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddc9d6-e858-45e0-a6a7-1bf00f1eb239 service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:33.553295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddc9d6-e858-45e0-a6a7-1bf00f1eb239 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:33.561366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddc9d6-e858-45e0-a6a7-1bf00f1eb239 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:33.563018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddc9d6-e858-45e0-a6a7-1bf00f1eb239 service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:33.572516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 760/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:53:36.027655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c547f2c-a373-4136-afe2-fd61de61de47 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:36.028224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c547f2c-a373-4136-afe2-fd61de61de47 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:36.028224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c547f2c-a373-4136-afe2-fd61de61de47 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:36.029620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:36.034823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15546-075a-4db6-98bd-e3bfe6de4738 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:36.035294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15546-075a-4db6-98bd-e3bfe6de4738 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:36.035403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a15546-075a-4db6-98bd-e3bfe6de4738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:36.055164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-56a15546-075a-4db6-98bd-e3bfe6de4738 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:36.057026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-56a15546-075a-4db6-98bd-e3bfe6de4738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:36.064783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:36.218695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c547f2c-a373-4136-afe2-fd61de61de47 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:36.233771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c547f2c-a373-4136-afe2-fd61de61de47 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:36.239174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e754405-e9c2-4130-a5e0-781186bb8b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:36.239774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754405-e9c2-4130-a5e0-781186bb8b23 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:36.240058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754405-e9c2-4130-a5e0-781186bb8b23 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:36.240334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754405-e9c2-4130-a5e0-781186bb8b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:36.249318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e754405-e9c2-4130-a5e0-781186bb8b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:36.250905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e754405-e9c2-4130-a5e0-781186bb8b23 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:36.260582 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 763/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:53:37.096365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410aa70-e56c-4285-8e38-22b14c7c84ba None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:37.096957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410aa70-e56c-4285-8e38-22b14c7c84ba None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:37.096957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410aa70-e56c-4285-8e38-22b14c7c84ba None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:37.098282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:37.103698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2cab2-c033-4e70-998d-d1953b77847b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:37.104153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2cab2-c033-4e70-998d-d1953b77847b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:37.104259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2cab2-c033-4e70-998d-d1953b77847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:37.124668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3cb2cab2-c033-4e70-998d-d1953b77847b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:37.125880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3cb2cab2-c033-4e70-998d-d1953b77847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:37.133894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:37.285264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410aa70-e56c-4285-8e38-22b14c7c84ba None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:37.299547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410aa70-e56c-4285-8e38-22b14c7c84ba None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:37.305211 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fe1ea-5c9b-4773-b81f-a07a8ee7d222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:37.306318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe1ea-5c9b-4773-b81f-a07a8ee7d222 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:37.306598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe1ea-5c9b-4773-b81f-a07a8ee7d222 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:37.306872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fe1ea-5c9b-4773-b81f-a07a8ee7d222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:37.314979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fe1ea-5c9b-4773-b81f-a07a8ee7d222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:37.316582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fe1ea-5c9b-4773-b81f-a07a8ee7d222 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:37.326647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 763/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:53:41.162889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53ccbe-86dd-49c7-847a-d4e58134ad7c None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:41.163472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53ccbe-86dd-49c7-847a-d4e58134ad7c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:41.163472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53ccbe-86dd-49c7-847a-d4e58134ad7c None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:41.164816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:41.170175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7765-6187-4520-ba84-23074517d600 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:41.170597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7765-6187-4520-ba84-23074517d600 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:41.170752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7765-6187-4520-ba84-23074517d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:41.190384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a7ad7765-6187-4520-ba84-23074517d600 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:41.191607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a7ad7765-6187-4520-ba84-23074517d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:41.200027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:41.534308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53ccbe-86dd-49c7-847a-d4e58134ad7c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:41.536009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-aa53ccbe-86dd-49c7-847a-d4e58134ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:41.569548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:53:41.616564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53ccbe-86dd-49c7-847a-d4e58134ad7c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:41.620415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e1ddc-ada6-42ee-b0e9-d4281f3bd57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:41.621025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1ddc-ada6-42ee-b0e9-d4281f3bd57e service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:41.621308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1ddc-ada6-42ee-b0e9-d4281f3bd57e service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:41.621585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e1ddc-ada6-42ee-b0e9-d4281f3bd57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:41.630696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1ddc-ada6-42ee-b0e9-d4281f3bd57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:41.632140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e1ddc-ada6-42ee-b0e9-d4281f3bd57e service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:41.642262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 766/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:53:43.589590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6619bd-4590-43ba-aedf-9ba8ad886b1b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:43.590035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6619bd-4590-43ba-aedf-9ba8ad886b1b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:43.590167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6619bd-4590-43ba-aedf-9ba8ad886b1b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:43.591546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:43.596951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c32d-3c9d-4b32-96ec-21998b10f125 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:43.597371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c32d-3c9d-4b32-96ec-21998b10f125 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:43.597509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9c32d-3c9d-4b32-96ec-21998b10f125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:43.619131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ecb9c32d-3c9d-4b32-96ec-21998b10f125 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:43.620401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ecb9c32d-3c9d-4b32-96ec-21998b10f125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:43.628530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:43.925899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6619bd-4590-43ba-aedf-9ba8ad886b1b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:43.936579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6619bd-4590-43ba-aedf-9ba8ad886b1b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:43.940091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fa6f4-5f2a-4c3f-8f4b-84bbf42b8ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:43.940717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa6f4-5f2a-4c3f-8f4b-84bbf42b8ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:43.941002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa6f4-5f2a-4c3f-8f4b-84bbf42b8ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:43.941277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fa6f4-5f2a-4c3f-8f4b-84bbf42b8ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:43.950423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fa6f4-5f2a-4c3f-8f4b-84bbf42b8ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:43.951916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fa6f4-5f2a-4c3f-8f4b-84bbf42b8ce3 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:43.963109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 766/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:53:47.691667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1746b3d-3aa6-4b14-97d2-923d8d61ba57 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:47.692262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1746b3d-3aa6-4b14-97d2-923d8d61ba57 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:47.692420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1746b3d-3aa6-4b14-97d2-923d8d61ba57 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:47.693715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:47.698873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd603-db66-4fc7-8d14-5e1532dd406d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:47.699315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd603-db66-4fc7-8d14-5e1532dd406d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:47.699427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccd603-db66-4fc7-8d14-5e1532dd406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:47.719781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5fccd603-db66-4fc7-8d14-5e1532dd406d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:47.721133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5fccd603-db66-4fc7-8d14-5e1532dd406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:47.730051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:48.281935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1746b3d-3aa6-4b14-97d2-923d8d61ba57 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:48.283608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d1746b3d-3aa6-4b14-97d2-923d8d61ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:48.363983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1746b3d-3aa6-4b14-97d2-923d8d61ba57 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:48.367557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939328a-5175-412d-b805-57c871baf854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:48.369049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939328a-5175-412d-b805-57c871baf854 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:48.369329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939328a-5175-412d-b805-57c871baf854 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:48.369606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939328a-5175-412d-b805-57c871baf854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:48.378444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939328a-5175-412d-b805-57c871baf854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:48.379887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939328a-5175-412d-b805-57c871baf854 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:48.389190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 769/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:53:50.317678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1a0d-2fb4-4152-ade7-5b259f1040b4 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:50.318252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1a0d-2fb4-4152-ade7-5b259f1040b4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:50.318252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1a0d-2fb4-4152-ade7-5b259f1040b4 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:50.319575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:53:50.325467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf8c2-b4b0-4c8e-b0bd-0aedcd87af91 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:50.325897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf8c2-b4b0-4c8e-b0bd-0aedcd87af91 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:50.326012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf8c2-b4b0-4c8e-b0bd-0aedcd87af91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:50.345125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c3fcf8c2-b4b0-4c8e-b0bd-0aedcd87af91 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:53:50.346317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c3fcf8c2-b4b0-4c8e-b0bd-0aedcd87af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:50.354662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:53:50.920902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1a0d-2fb4-4152-ade7-5b259f1040b4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:53:50.922574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb2f1a0d-2fb4-4152-ade7-5b259f1040b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:53:50.935369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1a0d-2fb4-4152-ade7-5b259f1040b4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:53:50.938873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868221a-dca1-4792-9ce1-d8f59dce8a54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:53:50.939463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868221a-dca1-4792-9ce1-d8f59dce8a54 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:53:50.939743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868221a-dca1-4792-9ce1-d8f59dce8a54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:53:50.940035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868221a-dca1-4792-9ce1-d8f59dce8a54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:53:50.948725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868221a-dca1-4792-9ce1-d8f59dce8a54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:53:50.950129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868221a-dca1-4792-9ce1-d8f59dce8a54 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:53:50.959193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 769/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:54:00.340265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=63 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:54:00.955175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=37 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:19.095221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73efe-0004-4a59-8261-25c6d3276342 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.096420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73efe-0004-4a59-8261-25c6d3276342 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.096952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73efe-0004-4a59-8261-25c6d3276342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.129187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3bd73efe-0004-4a59-8261-25c6d3276342 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.131324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3bd73efe-0004-4a59-8261-25c6d3276342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.139982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 771/1540] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.149461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71002aa9-f0aa-43cf-a40a-094e516a1ca0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.151240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71002aa9-f0aa-43cf-a40a-094e516a1ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.151765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71002aa9-f0aa-43cf-a40a-094e516a1ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.178777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-71002aa9-f0aa-43cf-a40a-094e516a1ca0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.180416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-71002aa9-f0aa-43cf-a40a-094e516a1ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.191598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 770/1541] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.199156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73efe-0004-4a59-8261-25c6d3276342 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.210578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73efe-0004-4a59-8261-25c6d3276342 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.221336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f336f8-0e7f-4655-913a-7d123f9f03b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.222416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f336f8-0e7f-4655-913a-7d123f9f03b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.222927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f336f8-0e7f-4655-913a-7d123f9f03b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.224018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f336f8-0e7f-4655-913a-7d123f9f03b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.225030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f336f8-0e7f-4655-913a-7d123f9f03b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:19.225579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f336f8-0e7f-4655-913a-7d123f9f03b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.227724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f336f8-0e7f-4655-913a-7d123f9f03b1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.246705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 772/1542] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:19.256856 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71002aa9-f0aa-43cf-a40a-094e516a1ca0 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.270103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71002aa9-f0aa-43cf-a40a-094e516a1ca0 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.278905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.279554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.279839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.280120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.280820 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.282847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.306499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b1878-4f71-4c3f-927d-7e7f4ba66c6b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.307175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b1878-4f71-4c3f-927d-7e7f4ba66c6b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.307679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b1878-4f71-4c3f-927d-7e7f4ba66c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.339206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d60b1878-4f71-4c3f-927d-7e7f4ba66c6b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.340844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d60b1878-4f71-4c3f-927d-7e7f4ba66c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.349023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 771/1543] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:19.356602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 773/1544] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:55:19.358316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.367516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244101-2a62-4405-bd88-e80bee47e860 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.368176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244101-2a62-4405-bd88-e80bee47e860 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.368699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4244101-2a62-4405-bd88-e80bee47e860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.407704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f4244101-2a62-4405-bd88-e80bee47e860 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.412427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f4244101-2a62-4405-bd88-e80bee47e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.492321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b01df-a2aa-43c8-a17a-9f013dc35e16 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.517808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f17a6-7ee0-4d26-af97-2b48bc829679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.518443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f17a6-7ee0-4d26-af97-2b48bc829679 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.518723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f17a6-7ee0-4d26-af97-2b48bc829679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.518996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f17a6-7ee0-4d26-af97-2b48bc829679 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.519649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f17a6-7ee0-4d26-af97-2b48bc829679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.521987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING py.warnings [None req-d73f17a6-7ee0-4d26-af97-2b48bc829679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:55:19.521987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: warnings.warn(msg) Aug 24 08:55:19.521987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: Aug 24 08:55:19.523227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73f17a6-7ee0-4d26-af97-2b48bc829679 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.564020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 774/1545] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:55:19.565356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952a2d-806a-4526-bb31-71ed32f50ed3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.566094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952a2d-806a-4526-bb31-71ed32f50ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.566094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53952a2d-806a-4526-bb31-71ed32f50ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.578988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 772/1546] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/users => generated 282 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:55:19.581254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa690342-5ac5-420e-b022-9f7478cd1b25 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.581978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa690342-5ac5-420e-b022-9f7478cd1b25 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.582675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa690342-5ac5-420e-b022-9f7478cd1b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.597534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-53952a2d-806a-4526-bb31-71ed32f50ed3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.598906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-53952a2d-806a-4526-bb31-71ed32f50ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.610617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 775/1547] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.611852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d25b-1ffb-40ab-87c2-fe076f54f871 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.611852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d25b-1ffb-40ab-87c2-fe076f54f871 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.611852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1d25b-1ffb-40ab-87c2-fe076f54f871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.613135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-aa690342-5ac5-420e-b022-9f7478cd1b25 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.614593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-aa690342-5ac5-420e-b022-9f7478cd1b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.628079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 773/1548] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.629356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa690342-5ac5-420e-b022-9f7478cd1b25 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.636426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-19a1d25b-1ffb-40ab-87c2-fe076f54f871 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.637957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-19a1d25b-1ffb-40ab-87c2-fe076f54f871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.641536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa690342-5ac5-420e-b022-9f7478cd1b25 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.646365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.646536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 776/1549] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.646974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.647254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.647368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1d25b-1ffb-40ab-87c2-fe076f54f871 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.647601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.648173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:19.648506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.649517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING py.warnings [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:55:19.649517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: warnings.warn(msg) Aug 24 08:55:19.649517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: Aug 24 08:55:19.650415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84858-cf70-49dd-a721-a5154c51b31d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.657425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1d25b-1ffb-40ab-87c2-fe076f54f871 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.663105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0b0f5-4331-4020-a227-36dc56698b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.663236 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0b0f5-4331-4020-a227-36dc56698b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.669094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0b0f5-4331-4020-a227-36dc56698b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.669579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 774/1550] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:19.669672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0b0f5-4331-4020-a227-36dc56698b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.669672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0b0f5-4331-4020-a227-36dc56698b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.669852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79725b-0fa4-4aca-8696-ef0e09a7c1a1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.669852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79725b-0fa4-4aca-8696-ef0e09a7c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.669852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79725b-0fa4-4aca-8696-ef0e09a7c1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.670129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0b0f5-4331-4020-a227-36dc56698b10 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.676437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 777/1551] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:19.678394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b45be-b400-40ea-86b0-a5cc876d1095 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.678677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b45be-b400-40ea-86b0-a5cc876d1095 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.678952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b45be-b400-40ea-86b0-a5cc876d1095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.686620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ac79725b-0fa4-4aca-8696-ef0e09a7c1a1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.687824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ac79725b-0fa4-4aca-8696-ef0e09a7c1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.695758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 775/1552] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.696973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527394c4-a8fb-4bff-b2ad-503708beda21 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.697277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527394c4-a8fb-4bff-b2ad-503708beda21 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.697480 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7e7b45be-b400-40ea-86b0-a5cc876d1095 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.697633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527394c4-a8fb-4bff-b2ad-503708beda21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.698674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e7b45be-b400-40ea-86b0-a5cc876d1095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.712948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 778/1553] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.712948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191fc3d-873d-4105-9841-95a5c09c9253 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.712948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191fc3d-873d-4105-9841-95a5c09c9253 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.712948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191fc3d-873d-4105-9841-95a5c09c9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.718405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-527394c4-a8fb-4bff-b2ad-503708beda21 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.719613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-527394c4-a8fb-4bff-b2ad-503708beda21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.728635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 776/1554] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.729886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7580-837b-411d-91fc-60d06487bf32 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.730172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7580-837b-411d-91fc-60d06487bf32 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.730445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7580-837b-411d-91fc-60d06487bf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.733382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e191fc3d-873d-4105-9841-95a5c09c9253 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.734598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e191fc3d-873d-4105-9841-95a5c09c9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.743003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 779/1555] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.744080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ddb3-f10b-4fc9-be3f-dd5305712d1a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.744359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ddb3-f10b-4fc9-be3f-dd5305712d1a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.744656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ddb3-f10b-4fc9-be3f-dd5305712d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.751448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-87dd7580-837b-411d-91fc-60d06487bf32 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.752879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-87dd7580-837b-411d-91fc-60d06487bf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.761614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 777/1556] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.762433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd7580-837b-411d-91fc-60d06487bf32 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.763976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2144ddb3-f10b-4fc9-be3f-dd5305712d1a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.765414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2144ddb3-f10b-4fc9-be3f-dd5305712d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.772254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd7580-837b-411d-91fc-60d06487bf32 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.774595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 780/1557] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.775286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144ddb3-f10b-4fc9-be3f-dd5305712d1a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.778835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339af5b3-5dc6-454d-88fc-83e2d5039336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.779432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af5b3-5dc6-454d-88fc-83e2d5039336 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.779767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af5b3-5dc6-454d-88fc-83e2d5039336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.779975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339af5b3-5dc6-454d-88fc-83e2d5039336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.780648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339af5b3-5dc6-454d-88fc-83e2d5039336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.782600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339af5b3-5dc6-454d-88fc-83e2d5039336 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.784459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144ddb3-f10b-4fc9-be3f-dd5305712d1a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.789198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e69cd-36c1-4523-a5fe-ab302a48bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.789783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e69cd-36c1-4523-a5fe-ab302a48bdfe admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.790068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e69cd-36c1-4523-a5fe-ab302a48bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.790342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e69cd-36c1-4523-a5fe-ab302a48bdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.790981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e69cd-36c1-4523-a5fe-ab302a48bdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.792613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e69cd-36c1-4523-a5fe-ab302a48bdfe admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.802741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 781/1558] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:19.803952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4420ea2-0d28-456a-a724-c05a2177f7cc None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.804237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4420ea2-0d28-456a-a724-c05a2177f7cc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.804539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4420ea2-0d28-456a-a724-c05a2177f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.814226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 778/1559] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:19.814226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c79a0-3a37-4913-9740-8a5b183a0063 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.814226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c79a0-3a37-4913-9740-8a5b183a0063 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.814226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c79a0-3a37-4913-9740-8a5b183a0063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.824951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b4420ea2-0d28-456a-a724-c05a2177f7cc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.826239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b4420ea2-0d28-456a-a724-c05a2177f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.832047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5d5c79a0-3a37-4913-9740-8a5b183a0063 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.833258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5d5c79a0-3a37-4913-9740-8a5b183a0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.880076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:19.886093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 782/1560] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.886968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4420ea2-0d28-456a-a724-c05a2177f7cc None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.896894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4420ea2-0d28-456a-a724-c05a2177f7cc None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.899472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 779/1561] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.900818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507aef1-2e23-439d-8c92-6b08603e5ffb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.901105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507aef1-2e23-439d-8c92-6b08603e5ffb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.901379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507aef1-2e23-439d-8c92-6b08603e5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.902350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.903508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.904024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.904525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.905187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:19.905491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.907089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.919668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 783/1562] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:19.920522 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.929109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c507aef1-2e23-439d-8c92-6b08603e5ffb None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:19.930342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c507aef1-2e23-439d-8c92-6b08603e5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:19.931999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2673-240d-4661-b465-74f712aae41d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.936691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.937313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.937594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.937897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.938295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 780/1563] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:19.938545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:19.938851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.939076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507aef1-2e23-439d-8c92-6b08603e5ffb None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.940516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.942024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:19.949215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507aef1-2e23-439d-8c92-6b08603e5ffb None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.953801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.954393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.954678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.954954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.955426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 784/1564] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:19.955635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:19.955904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.956211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.957531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.967872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a01923-66d7-4c03-ad3b-8e0fb5fde018 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.972453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.973138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 781/1565] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:19.973272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.973356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.973615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] PATH_INFO: `/v3/projects/0063578905ee4b05ab4cc9c7bd28462b/users/18ecdd63ae2b48e6ba6551eeac8a8bce/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.973907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:19.983305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800aa957-26ce-4c66-bd0f-f7013014fdb3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:19.988009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:19.988746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:19.990556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:19.990836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:19.991462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.993407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:19.993570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0063578905ee4b05ab4cc9c7bd28462b, user_id=18ecdd63ae2b48e6ba6551eeac8a8bce, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:19.994614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:55:19.994614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:55:19.994614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:55:19.996555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.011590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 785/1566] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:19 2022] PUT /identity/v3/projects/0063578905ee4b05ab4cc9c7bd28462b/users/18ecdd63ae2b48e6ba6551eeac8a8bce/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:20.022550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.022669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 782/1567] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:19 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.022669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.032834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2439ed9-9846-4e8f-acd6-b9853ea14b06 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.097040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f23f9-c7e9-4a2b-b6e5-769a59f5aca1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.100823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.101481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.101783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.101903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.102065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.102450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.102717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:20.102836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.102981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.103085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.103625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:20.103926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.104642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.105562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.119488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 783/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:20.120303 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 786/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:20.121114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.124515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.133350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3da8c-ca4d-4732-95e4-002c0bb69b38 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.138029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbbdbf-bbaf-4abe-a750-ab6cfd159dbb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.138172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.138724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.139007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.139280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.139962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:20.140266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.141925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.143467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.144074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.144351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.144643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.145268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.147186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.154472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 787/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:20.155272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.164736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83c509-1685-4224-883b-e3b49d3b717d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.169451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.170041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.170341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.170618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.171237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.172263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:55:20.172263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:55:20.172263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:55:20.173485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.178370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 784/1571] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.178370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.201770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 788/1572] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.202661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.238053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74938e0f-8aae-4209-862e-25c63ec75d91 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.265725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697bc55-e6db-4aaf-9f53-bae13ce1a436 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.269317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:20.270647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c553c21-9543-4ec6-88f8-ea662b1281e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.271367 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c553c21-9543-4ec6-88f8-ea662b1281e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.271735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c553c21-9543-4ec6-88f8-ea662b1281e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.272013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c553c21-9543-4ec6-88f8-ea662b1281e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.272699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c553c21-9543-4ec6-88f8-ea662b1281e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.274306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c553c21-9543-4ec6-88f8-ea662b1281e5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.284003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 789/1573] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:20.285288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1762f8-fa43-421d-8fc4-f3b787149a9e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.285570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1762f8-fa43-421d-8fc4-f3b787149a9e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.285849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1762f8-fa43-421d-8fc4-f3b787149a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.299672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.300288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.300641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.300922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.301602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.304046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.314960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cb1762f8-fa43-421d-8fc4-f3b787149a9e None None] MFA Rules not processed for user `18ecdd63ae2b48e6ba6551eeac8a8bce`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:20.316164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cb1762f8-fa43-421d-8fc4-f3b787149a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:20.328455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:20.333640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 785/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.335020 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.383657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 790/1575] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:20.384355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1762f8-fa43-421d-8fc4-f3b787149a9e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.394432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1762f8-fa43-421d-8fc4-f3b787149a9e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.398981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b9def-da1d-45c0-8adc-a19a23097edc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.399485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.400069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.400346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.400703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.401250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.403142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.403511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.404121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.404429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.404706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.405333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.407227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.431382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 791/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.432194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.438127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 786/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.438127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.495054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9c5fe-8fbf-4e91-8513-bd49aad91423 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.500300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.500638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e601d0-1a1b-4cae-9eeb-cacd38cce1b2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.500943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.501226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.501505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.502130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.504055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.505235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.506369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.506653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.506930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.507555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.509912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.532422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 787/1578] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.535921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 792/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.536750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.536866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.546661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df075c-9d5f-4736-97a0-cc0fe75e53f6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.579898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:20.598886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae205ef8-8fd9-4260-99cc-360be2c971d4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.603877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.604518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.604828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.605146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.605834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.607454 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.610336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.610982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.611319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.611624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.612255 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.614204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.618119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 793/1580] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:20.618789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.628949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9039fc-fbca-4912-b51d-69cfdd4b7d07 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.634710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.635226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.635513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.635788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.636430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.636877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 788/1581] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.638347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.640584 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.650740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e282c-89e9-4bf9-9c66-2984c6a10410 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.650898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:20.656036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.656588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.656968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.657288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.657940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.659834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.663934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 794/1582] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.664795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.678973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787fd7c-69d7-4f07-a145-70ca8dd2b5da admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.685979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.686854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.687290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.687676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.688720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.690934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 789/1583] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.691683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.691821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.720759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 795/1584] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/users => generated 295 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.720759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.731129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876360e-2cbf-4de3-a669-88fcc69176f3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.759972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a975-c499-47ff-8857-d1e5a9bb07d5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.764868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.765477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.765755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.766030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.766651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.768576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.789392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 790/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.790171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.795399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.796044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.796327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.796631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.797279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.798928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.801819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6aafe-c2fb-4dde-be31-162882f94634 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.806844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.807421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.807698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.807970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.808608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.809646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 796/1586] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:20.810420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.810607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.823165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb47e1-13d4-4425-92d8-ea264a86c51b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.828536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.829187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.829467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.829741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] PATH_INFO: `/v3/projects/2bbff5049b734eefb34a95486ea55097/users/957be2fd55a04d70a15b4006d472beda/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.836014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 791/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.836014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.843384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bac2c-5002-47d4-9eac-e53a3372f33d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.847336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbff5049b734eefb34a95486ea55097, user_id=957be2fd55a04d70a15b4006d472beda, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.847886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.848503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.848789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.849070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.849715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.850072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.851311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.862060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 792/1588] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:20.863100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 797/1589] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:20 2022] PUT /identity/v3/projects/2bbff5049b734eefb34a95486ea55097/users/957be2fd55a04d70a15b4006d472beda/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:20.863238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.863530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.883625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bda1df-63dd-4429-8428-078c44a3bcf1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.926375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a4c20-31c7-4c85-8563-dffd841c60fd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.932201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.932841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.933141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.933419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.934047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.935983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.940188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.940832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.941115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.941392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.942054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.943699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.945871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:20.959113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 793/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:20.959113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.959374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 798/1591] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:20 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:20.960102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.969953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551bbc5-75c0-4b69-aacd-1dfe8497f70e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.970436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46619a80-9034-4af8-913a-2bce758025b1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:20.974666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.975041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:20.975254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.975535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.975643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:20.975814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.976056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:20.976157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:20.976484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.976849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:20.978178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.978411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:20.991946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 794/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:20.992228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 799/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:20.992336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.992792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:20.999321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb98d61-c6a5-44e0-bf6a-c4a670e2567c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.001084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c7a88-4b8a-4db4-b6e0-c6904fc51ca9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.003862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133bb51-e18d-4ed6-865f-adb7c3bafbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.004467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133bb51-e18d-4ed6-865f-adb7c3bafbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.004749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133bb51-e18d-4ed6-865f-adb7c3bafbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.005024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133bb51-e18d-4ed6-865f-adb7c3bafbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.005679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.005839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133bb51-e18d-4ed6-865f-adb7c3bafbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.006260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.006540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.006816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.007353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133bb51-e18d-4ed6-865f-adb7c3bafbc1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.007463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.009064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.019346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 795/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.020151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.022941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 800/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.024768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb0b5-5c2a-425d-9d50-631f9e71a4ad None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.025183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb0b5-5c2a-425d-9d50-631f9e71a4ad None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.025584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb0b5-5c2a-425d-9d50-631f9e71a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.030359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80bc47-17f5-46df-b858-f732d3be3b8c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.034916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.035511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.035794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.036071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.037470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.039270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.052425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 796/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.052425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.058442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-de7fb0b5-5c2a-425d-9d50-631f9e71a4ad None None] MFA Rules not processed for user `957be2fd55a04d70a15b4006d472beda`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.059920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de7fb0b5-5c2a-425d-9d50-631f9e71a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.060528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1e55f-cfc2-4548-bef6-e7d9885185c1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.065097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.065441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:21.065687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.065968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.066343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.067179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.069303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.079473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 797/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.080185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.090794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b239f-242a-4557-9961-d2b9786830d9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.095322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.095911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.096278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.096498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.097132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.098724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.109097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 798/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.109822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.120060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d1aa7-128b-4459-beb6-063f0d344dab admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.124573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.125165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.125442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.125711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.126342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.127908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.128756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 801/1599] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.129667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb0b5-5c2a-425d-9d50-631f9e71a4ad None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.141683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb0b5-5c2a-425d-9d50-631f9e71a4ad None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.148096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 799/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.148096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.148320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.148478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.149325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.149607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.150263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.151873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.155897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b69e5-6528-42f2-95cb-19f151ccc13e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.160777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.161524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.161874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.162297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] PATH_INFO: `/v3/projects/2826b194b41142218006535f9eeec332/users/f0602554c12e4710912338a9ddccbbd2/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.168191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 802/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.168191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.177539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2826b194b41142218006535f9eeec332, user_id=f0602554c12e4710912338a9ddccbbd2, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.180297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.180907 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb6e6-bfb7-4060-a23e-4f0487bfeae6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.185703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.186505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.186830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.187111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.187845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.189657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.195087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 800/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/2826b194b41142218006535f9eeec332/users/f0602554c12e4710912338a9ddccbbd2/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.196435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.203727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 803/1603] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.203727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.212249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50bea1-029a-47cb-8cf5-714a0de3ae17 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.264271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20f17a-dd78-4f7b-a1b9-12ae1819ff14 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.268900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.269564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.269848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.270125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] PATH_INFO: `/v3/projects/6b51437e5705454288ae58ad703f7330/users/97d63b77d6914ab58f4b745d0a0e5470/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.271401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.272060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.272344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.272718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] PATH_INFO: `/v3/projects/dbf5e3c7a7d04f9596a090175bf71321/users/1d6c68a0197548ab91bd66342974dd28/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.284852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b51437e5705454288ae58ad703f7330, user_id=97d63b77d6914ab58f4b745d0a0e5470, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.287501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5e3c7a7d04f9596a090175bf71321, user_id=1d6c68a0197548ab91bd66342974dd28, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.288093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.290365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.305588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 801/1604] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/6b51437e5705454288ae58ad703f7330/users/97d63b77d6914ab58f4b745d0a0e5470/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.305588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.308106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 804/1605] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/dbf5e3c7a7d04f9596a090175bf71321/users/1d6c68a0197548ab91bd66342974dd28/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.309071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.355948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:21.368641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cac25-5bcd-4b98-903c-b9cc4737773a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.373357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73822c5-37c8-4fe0-9a4f-082b9b6afa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.374120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73822c5-37c8-4fe0-9a4f-082b9b6afa05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.374505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73822c5-37c8-4fe0-9a4f-082b9b6afa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.374790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73822c5-37c8-4fe0-9a4f-082b9b6afa05 admin admin] PATH_INFO: `/v3/projects/ac37179bd4bf49e1875741c63b8010ca/users/d4b0980b5ae64e09964b6b716489e6a7/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.375297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9427f-e041-4c6b-af64-5772c1d74655 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.379941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31256bcc-1735-495c-9797-16da0ef17fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.381177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256bcc-1735-495c-9797-16da0ef17fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.381462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256bcc-1735-495c-9797-16da0ef17fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.381741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256bcc-1735-495c-9797-16da0ef17fce admin admin] PATH_INFO: `/v3/projects/1c90722aa00a44e2a945372c5a51d93d/users/a42d659ce7bb4946bd082a07d9339e4e/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.389665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73822c5-37c8-4fe0-9a4f-082b9b6afa05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac37179bd4bf49e1875741c63b8010ca, user_id=d4b0980b5ae64e09964b6b716489e6a7, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.392315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73822c5-37c8-4fe0-9a4f-082b9b6afa05 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.393563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:21.398530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31256bcc-1735-495c-9797-16da0ef17fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c90722aa00a44e2a945372c5a51d93d, user_id=a42d659ce7bb4946bd082a07d9339e4e, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.402262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31256bcc-1735-495c-9797-16da0ef17fce admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.407748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 802/1606] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/ac37179bd4bf49e1875741c63b8010ca/users/d4b0980b5ae64e09964b6b716489e6a7/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.409201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844cf6-3fdf-40f2-a770-0b0ed28f2e53 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.409498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844cf6-3fdf-40f2-a770-0b0ed28f2e53 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.409775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844cf6-3fdf-40f2-a770-0b0ed28f2e53 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.411602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 803/1607] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 08:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:21.412267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9844cf6-3fdf-40f2-a770-0b0ed28f2e53 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.417625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 805/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/1c90722aa00a44e2a945372c5a51d93d/users/a42d659ce7bb4946bd082a07d9339e4e/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.418826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7321d-8cae-4b93-994a-47055034d905 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.419114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7321d-8cae-4b93-994a-47055034d905 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.419388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7321d-8cae-4b93-994a-47055034d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.438064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-40d7321d-8cae-4b93-994a-47055034d905 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.439181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-40d7321d-8cae-4b93-994a-47055034d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.481957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9844cf6-3fdf-40f2-a770-0b0ed28f2e53 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.486789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66a742-e1b1-4bb3-98ad-66945109b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.487550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66a742-e1b1-4bb3-98ad-66945109b774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.487886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66a742-e1b1-4bb3-98ad-66945109b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.488234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66a742-e1b1-4bb3-98ad-66945109b774 admin admin] PATH_INFO: `/v3/projects/cee109db5d084b15b58e6ae9fbadb659/users/33e436cd09274025be98e422634300ba/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.501099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 806/1609] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.502070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7321d-8cae-4b93-994a-47055034d905 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.503048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66a742-e1b1-4bb3-98ad-66945109b774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee109db5d084b15b58e6ae9fbadb659, user_id=33e436cd09274025be98e422634300ba, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.506160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66a742-e1b1-4bb3-98ad-66945109b774 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.512054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7321d-8cae-4b93-994a-47055034d905 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.517312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8133178-f3c1-41b6-91d9-c540ca0a7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.517998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8133178-f3c1-41b6-91d9-c540ca0a7738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.518281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8133178-f3c1-41b6-91d9-c540ca0a7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.518561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8133178-f3c1-41b6-91d9-c540ca0a7738 admin admin] PATH_INFO: `/v3/projects/9c79180953744b7788c10e78d3541473/users/4b61fdbcc69d493894a96f93aee02ca3/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.520804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 804/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/cee109db5d084b15b58e6ae9fbadb659/users/33e436cd09274025be98e422634300ba/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.529925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b9a36-7c74-43bf-86ae-b8579e5e6703 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.530289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b9a36-7c74-43bf-86ae-b8579e5e6703 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.530676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b9a36-7c74-43bf-86ae-b8579e5e6703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.534412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8133178-f3c1-41b6-91d9-c540ca0a7738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c79180953744b7788c10e78d3541473, user_id=4b61fdbcc69d493894a96f93aee02ca3, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.537781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8133178-f3c1-41b6-91d9-c540ca0a7738 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.551271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-549b9a36-7c74-43bf-86ae-b8579e5e6703 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.551859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 807/1611] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/9c79180953744b7788c10e78d3541473/users/4b61fdbcc69d493894a96f93aee02ca3/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.552553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-549b9a36-7c74-43bf-86ae-b8579e5e6703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.553095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165f6c9-4799-4515-877a-c82e943f99b9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.553384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165f6c9-4799-4515-877a-c82e943f99b9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.553660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165f6c9-4799-4515-877a-c82e943f99b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.574733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e165f6c9-4799-4515-877a-c82e943f99b9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.575950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e165f6c9-4799-4515-877a-c82e943f99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.618656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 805/1612] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.619671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b9a36-7c74-43bf-86ae-b8579e5e6703 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.629473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b9a36-7c74-43bf-86ae-b8579e5e6703 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.634122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc9dcc-41a8-43be-976e-245ee0b35307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.634722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc9dcc-41a8-43be-976e-245ee0b35307 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.635008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc9dcc-41a8-43be-976e-245ee0b35307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.635290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc9dcc-41a8-43be-976e-245ee0b35307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.635935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc9dcc-41a8-43be-976e-245ee0b35307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.637568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc9dcc-41a8-43be-976e-245ee0b35307 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.639065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 808/1613] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.640394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbf6d7-6c1f-4415-9718-f4cd5360eda1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.640709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbf6d7-6c1f-4415-9718-f4cd5360eda1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.640987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbf6d7-6c1f-4415-9718-f4cd5360eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.651336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 806/1614] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:21.651336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688dd54-cadb-40b8-8acd-246ea8e4d036 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.651336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688dd54-cadb-40b8-8acd-246ea8e4d036 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.651336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688dd54-cadb-40b8-8acd-246ea8e4d036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.669510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2688dd54-cadb-40b8-8acd-246ea8e4d036 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.670796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2688dd54-cadb-40b8-8acd-246ea8e4d036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.678976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 807/1615] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.679847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688dd54-cadb-40b8-8acd-246ea8e4d036 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.684111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-46fbf6d7-6c1f-4415-9718-f4cd5360eda1 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.685532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-46fbf6d7-6c1f-4415-9718-f4cd5360eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.731720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:21.737448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:21.748576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688dd54-cadb-40b8-8acd-246ea8e4d036 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.752746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae2023-e386-4944-9684-cef9a029a12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.753471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2023-e386-4944-9684-cef9a029a12b service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.753854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2023-e386-4944-9684-cef9a029a12b service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.754252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2023-e386-4944-9684-cef9a029a12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.759535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 809/1616] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.761112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74df67-0826-461d-a685-1e58e908f176 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.761886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74df67-0826-461d-a685-1e58e908f176 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.761886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74df67-0826-461d-a685-1e58e908f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.763903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae2023-e386-4944-9684-cef9a029a12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.765459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae2023-e386-4944-9684-cef9a029a12b service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.776176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 808/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:21.777770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6f9b-d1f5-4821-ae02-092478c25622 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.778069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6f9b-d1f5-4821-ae02-092478c25622 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.778487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6f9b-d1f5-4821-ae02-092478c25622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.791223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6d74df67-0826-461d-a685-1e58e908f176 None None] MFA Rules not processed for user `33e436cd09274025be98e422634300ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.792467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6d74df67-0826-461d-a685-1e58e908f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.809450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-299e6f9b-d1f5-4821-ae02-092478c25622 None None] MFA Rules not processed for user `4b61fdbcc69d493894a96f93aee02ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:21.810975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-299e6f9b-d1f5-4821-ae02-092478c25622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:21.869460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 810/1618] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.870630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74df67-0826-461d-a685-1e58e908f176 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.881344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74df67-0826-461d-a685-1e58e908f176 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.885432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.886204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.886836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.887393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.899855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.901841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.902234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 809/1619] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:21.903541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6f9b-d1f5-4821-ae02-092478c25622 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.915034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6f9b-d1f5-4821-ae02-092478c25622 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.915683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 811/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:21.916701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.919978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.920840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.921558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.922498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.928105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e05d98-2636-4422-bed6-cc47172998c6 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.940237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:21.940978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:21.941273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:21.941526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.943670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] PATH_INFO: `/v3/projects/ac37179bd4bf49e1875741c63b8010ca/users/d4b0980b5ae64e09964b6b716489e6a7/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:21.943970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.948756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac37179bd4bf49e1875741c63b8010ca, user_id=d4b0980b5ae64e09964b6b716489e6a7, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:21.954372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:21.955025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 810/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:21.955951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:21.965134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22ccc6-82db-4a7a-99dc-e9399e78cd00 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:21.968906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 812/1622] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:21 2022] PUT /identity/v3/projects/ac37179bd4bf49e1875741c63b8010ca/users/d4b0980b5ae64e09964b6b716489e6a7/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:21.969987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.034238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.034865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.035150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.035429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.065095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192a1ef-4aa4-4931-a39b-aa9b7b31a21c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.073452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.074188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.074484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.074692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.106995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.108467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.119275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 811/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:22.119938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.129729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f51ae9-0574-4e9b-9dd2-474323071a74 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.131015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:22.136513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270febc-f92e-4913-9224-93e1be8511bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.137207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270febc-f92e-4913-9224-93e1be8511bf admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.137570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270febc-f92e-4913-9224-93e1be8511bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.137910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270febc-f92e-4913-9224-93e1be8511bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.138582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270febc-f92e-4913-9224-93e1be8511bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.140551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270febc-f92e-4913-9224-93e1be8511bf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.146910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.148177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:22.148943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.160376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 813/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:22.161240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.171830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10070-918c-4116-b5a5-bbae4ffd9849 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.173047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 812/1625] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:22 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:22.174707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae081-2d2e-4f1c-abd0-c6e8fa23207c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.175053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae081-2d2e-4f1c-abd0-c6e8fa23207c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.175337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae081-2d2e-4f1c-abd0-c6e8fa23207c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.204950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a7eae081-2d2e-4f1c-abd0-c6e8fa23207c None None] MFA Rules not processed for user `d4b0980b5ae64e09964b6b716489e6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:22.206554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a7eae081-2d2e-4f1c-abd0-c6e8fa23207c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:22.236159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.236904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.237439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.237633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.238318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.243576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.282450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 814/1626] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:22 2022] POST /identity/v3/projects => generated 361 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:22.282450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.319754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 813/1627] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:22.319754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae081-2d2e-4f1c-abd0-c6e8fa23207c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.357892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae081-2d2e-4f1c-abd0-c6e8fa23207c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.372017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.372279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f331834-23ab-45f8-8b60-f52efbac4926 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.372706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.372993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.373297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.375290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.379192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.380301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.381363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.382584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.382724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.383835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.386452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.417017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 815/1628] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:22 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:22.417017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.431911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 814/1629] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:22 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:22.431911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.464537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e385-2b94-4c01-9061-a9ce9db4d1e2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.484309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.484977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.485262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.485548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.486213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.487818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.503331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af3815-69d3-420c-b2f7-679ae853a365 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.512538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 815/1630] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:22.514550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.514767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.515614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.517722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.518113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.538166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1821928-d19c-4a04-94e5-4771a08c932d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.543344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:22.549616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.550257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.550541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.550818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.551478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.553265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.579345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 816/1631] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:22.580861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.597647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6b3d1-4ff7-4729-b3fb-b2ced5be612d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.605441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd860-d8bb-4324-a2b7-db8b10d8228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.606414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd860-d8bb-4324-a2b7-db8b10d8228a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.606711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd860-d8bb-4324-a2b7-db8b10d8228a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.606998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd860-d8bb-4324-a2b7-db8b10d8228a admin admin] PATH_INFO: `/v3/projects/677794e4ad7447e79116b6adefeedfaa/users/523a772c2df24f43b46f254d584abc1a/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.625682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd860-d8bb-4324-a2b7-db8b10d8228a admin admin] RBAC: Authorizing `identity:create_grant(project_id=677794e4ad7447e79116b6adefeedfaa, user_id=523a772c2df24f43b46f254d584abc1a, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.628616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd860-d8bb-4324-a2b7-db8b10d8228a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.634060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.636100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.648251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 817/1632] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:22 2022] PUT /identity/v3/projects/677794e4ad7447e79116b6adefeedfaa/users/523a772c2df24f43b46f254d584abc1a/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:22.649478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 816/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:22.649604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1822-fca7-4ecd-9a18-02fdbf391baf None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.649901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1822-fca7-4ecd-9a18-02fdbf391baf None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.650182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1822-fca7-4ecd-9a18-02fdbf391baf None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.650771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.664783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3286b5-ba10-49dc-82b1-68ef21aa06c3 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.665052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 818/1634] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 24 08:55:22 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:22.668154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1822-fca7-4ecd-9a18-02fdbf391baf None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.766541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439e3e6-93d2-4743-918c-c90db49ab34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.767681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e3e6-93d2-4743-918c-c90db49ab34a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.769205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e3e6-93d2-4743-918c-c90db49ab34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.769781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e3e6-93d2-4743-918c-c90db49ab34a admin admin] PATH_INFO: `/v3/projects/8cb1d36be5aa4c95b7afc359db70167e/users/b8c7b737170c49f0a1a16306b0950b5b/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.793278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439e3e6-93d2-4743-918c-c90db49ab34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb1d36be5aa4c95b7afc359db70167e, user_id=b8c7b737170c49f0a1a16306b0950b5b, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.800467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439e3e6-93d2-4743-918c-c90db49ab34a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.813944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b1822-fca7-4ecd-9a18-02fdbf391baf None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:22.818460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 817/1635] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:22 2022] PUT /identity/v3/projects/8cb1d36be5aa4c95b7afc359db70167e/users/b8c7b737170c49f0a1a16306b0950b5b/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:22.820184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a365c3-0397-43aa-80dd-612c80cd444b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.821379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a365c3-0397-43aa-80dd-612c80cd444b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.822026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a365c3-0397-43aa-80dd-612c80cd444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.830898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:22.868325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-59a365c3-0397-43aa-80dd-612c80cd444b None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:22.870550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-59a365c3-0397-43aa-80dd-612c80cd444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:22.924935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:22.925550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:22.925935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:22.926219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:22.927546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:22.929050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:22.954766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 819/1636] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:22.955750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:22.994667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 818/1637] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:55:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:22.996304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a365c3-0397-43aa-80dd-612c80cd444b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:23.011431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a365c3-0397-43aa-80dd-612c80cd444b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:23.017943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:23.018866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.019353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.019817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.021232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:23.023341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:23.077215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 819/1638] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:23.080075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:23.087689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b1910-46aa-4a7e-b0a9-119feee3b68b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:23.095460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f42e28-d9be-4433-843e-758b2c8828ab admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:23.097039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:23.097731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.098086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.098426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.102032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:23.103101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.103541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.103991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] PATH_INFO: `/v3/projects/677794e4ad7447e79116b6adefeedfaa/users/523a772c2df24f43b46f254d584abc1a/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.107017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=677794e4ad7447e79116b6adefeedfaa, user_id=523a772c2df24f43b46f254d584abc1a, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:23.110796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:23.129030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 820/1639] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:23 2022] PUT /identity/v3/projects/677794e4ad7447e79116b6adefeedfaa/users/523a772c2df24f43b46f254d584abc1a/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:23.130481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:23.141703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:23.219386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:23.221097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:23.231055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03878-7f6a-4a5d-982d-db6235397a51 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:23.236448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b561f-56e1-41c3-9a3a-3a574c1f9b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:23.237458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b561f-56e1-41c3-9a3a-3a574c1f9b9f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.237896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b561f-56e1-41c3-9a3a-3a574c1f9b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.238845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b561f-56e1-41c3-9a3a-3a574c1f9b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.247560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 820/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:23.248340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:23.270672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0a430-9f76-4537-b144-443664742058 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:23.393807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e43d9b-4e00-4252-b624-262c9e58d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:23.394487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e43d9b-4e00-4252-b624-262c9e58d457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.394780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e43d9b-4e00-4252-b624-262c9e58d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.395039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e43d9b-4e00-4252-b624-262c9e58d457 admin admin] PATH_INFO: `/v3/projects/8cb1d36be5aa4c95b7afc359db70167e/users/b8c7b737170c49f0a1a16306b0950b5b/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.402527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e43d9b-4e00-4252-b624-262c9e58d457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cb1d36be5aa4c95b7afc359db70167e, user_id=b8c7b737170c49f0a1a16306b0950b5b, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:23.406367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e43d9b-4e00-4252-b624-262c9e58d457 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:23.426089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b561f-56e1-41c3-9a3a-3a574c1f9b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:23.426967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:23.429627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b561f-56e1-41c3-9a3a-3a574c1f9b9f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:23.441510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 821/1641] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:23 2022] PUT /identity/v3/projects/8cb1d36be5aa4c95b7afc359db70167e/users/b8c7b737170c49f0a1a16306b0950b5b/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:23.443607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4234f9-5559-4707-abf7-7c5a22612ca6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.443892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4234f9-5559-4707-abf7-7c5a22612ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.444168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4234f9-5559-4707-abf7-7c5a22612ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.474535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 821/1642] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:23.477726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488208-1673-4c4c-a781-d9557e492f9e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.478187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488208-1673-4c4c-a781-d9557e492f9e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.480916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488208-1673-4c4c-a781-d9557e492f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.513194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4b4234f9-5559-4707-abf7-7c5a22612ca6 None None] MFA Rules not processed for user `523a772c2df24f43b46f254d584abc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:23.514460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4b4234f9-5559-4707-abf7-7c5a22612ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:23.563740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-51488208-1673-4c4c-a781-d9557e492f9e None None] MFA Rules not processed for user `b8c7b737170c49f0a1a16306b0950b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:23.565311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-51488208-1673-4c4c-a781-d9557e492f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:23.751483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 822/1643] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:23.766658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488208-1673-4c4c-a781-d9557e492f9e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:23.772040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 822/1644] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:23.838037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:23.871394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488208-1673-4c4c-a781-d9557e492f9e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:23.875349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:23.876021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:23.876362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:23.876615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:23.890784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:23.895055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:23.913261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 823/1645] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:55:24.006755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4234f9-5559-4707-abf7-7c5a22612ca6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:24.023325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4234f9-5559-4707-abf7-7c5a22612ca6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:24.035436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786ea09-07c3-4993-ac3a-93caa421a5ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:24.036442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786ea09-07c3-4993-ac3a-93caa421a5ff service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:24.037478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786ea09-07c3-4993-ac3a-93caa421a5ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:24.038054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786ea09-07c3-4993-ac3a-93caa421a5ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:24.076604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786ea09-07c3-4993-ac3a-93caa421a5ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:24.083062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786ea09-07c3-4993-ac3a-93caa421a5ff service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:24.108463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 823/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:24.319243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:24.346654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41b0c-e374-4f67-b3be-867eeef261cd service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:24.355036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052ea11-ab3b-4238-934b-ade66d4360ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:24.357703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052ea11-ab3b-4238-934b-ade66d4360ee service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:24.358045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052ea11-ab3b-4238-934b-ade66d4360ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:24.358978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052ea11-ab3b-4238-934b-ade66d4360ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:24.496468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052ea11-ab3b-4238-934b-ade66d4360ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:24.506109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052ea11-ab3b-4238-934b-ade66d4360ee service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:24.529683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 824/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:25.182828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d305f3-523f-4ded-ad3f-ca19de8d0204 None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:25.183423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d305f3-523f-4ded-ad3f-ca19de8d0204 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:25.183665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d305f3-523f-4ded-ad3f-ca19de8d0204 None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:25.186005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 824/1648] 10.222.0.42 () {54 vars in 962 bytes} [Wed Aug 24 08:55:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:25.195212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4ad1-bc22-4835-8053-7d5f656ad7d7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:25.195497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4ad1-bc22-4835-8053-7d5f656ad7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:25.195779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e4ad1-bc22-4835-8053-7d5f656ad7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:25.253471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-839e4ad1-bc22-4835-8053-7d5f656ad7d7 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:25.254873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-839e4ad1-bc22-4835-8053-7d5f656ad7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:25.280553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d305f3-523f-4ded-ad3f-ca19de8d0204 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:25.444014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d305f3-523f-4ded-ad3f-ca19de8d0204 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:25.452021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 825/1649] 10.222.0.42 () {58 vars in 1059 bytes} [Wed Aug 24 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:25.458863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:25.459664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f689-e30d-41a2-a290-9ee21fbdf510 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:25.459980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f689-e30d-41a2-a290-9ee21fbdf510 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:25.460292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08f689-e30d-41a2-a290-9ee21fbdf510 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:25.460746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:25.461971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 826/1650] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 24 08:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:25.466603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:25.468025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49214b68-c9f7-4ed9-a21c-04e9cabc822b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:25.468491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49214b68-c9f7-4ed9-a21c-04e9cabc822b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:25.468682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] PATH_INFO: `/v3/users/4b61fdbcc69d493894a96f93aee02ca3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:25.468786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49214b68-c9f7-4ed9-a21c-04e9cabc822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:25.470142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b61fdbcc69d493894a96f93aee02ca3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:25.475129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:25.537427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-49214b68-c9f7-4ed9-a21c-04e9cabc822b None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:25.539617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-49214b68-c9f7-4ed9-a21c-04e9cabc822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:25.562314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 827/1651] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:25.580839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49214b68-c9f7-4ed9-a21c-04e9cabc822b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:25.597786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49214b68-c9f7-4ed9-a21c-04e9cabc822b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:25.604977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b61fdbcc69d493894a96f93aee02ca3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:25.606032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:25.606971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b61fdbcc69d493894a96f93aee02ca3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:25.607750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b61fdbcc69d493894a96f93aee02ca3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:25.609051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:25.609580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:25.610257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:25.613014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:25.630178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b61fdbcc69d493894a96f93aee02ca3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:25.630953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:25.633949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:25.646302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8de0686a-ba4d-4e84-b3be-2a81e8dd2e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b61fdbcc69d493894a96f93aee02ca3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:25.669593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:25.684591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 825/1652] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:25 2022] DELETE /identity/v3/users/4b61fdbcc69d493894a96f93aee02ca3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:25.689502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:25.689929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:25.690439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:25.692538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 828/1653] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:55:25.739407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:25.741718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:25.849991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 826/1654] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:25.871946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:25.874152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:26.067447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:26.128116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688af8a-21de-4ef0-ac23-4d9f95845c20 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:26.308153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:26.308856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:26.309148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:26.309426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:26.330670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:26.333177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:26.358736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 829/1655] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:27.215753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:27.218994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:27.247199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ffee2-4726-4133-9cb6-e1158e5ba6a7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:27.281842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:27.281842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:27.281842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:27.281842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] PATH_INFO: `/v3/projects/9c79180953744b7788c10e78d3541473` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:27.286053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c79180953744b7788c10e78d3541473)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:27.294478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: WARNING py.warnings [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:55:27.294478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: warnings.warn(msg) Aug 24 08:55:27.294478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: Aug 24 08:55:27.298501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:27.427597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c79180953744b7788c10e78d3541473', 'request_id': 'req-a9a77878-2201-484a-beb2-e5f8ab2daf53'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.445577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c79180953744b7788c10e78d3541473', 'request_id': 'req-a9a77878-2201-484a-beb2-e5f8ab2daf53'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.462319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c79180953744b7788c10e78d3541473', 'request_id': 'req-a9a77878-2201-484a-beb2-e5f8ab2daf53'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.506427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] The token cache is being invalidate because project 9c79180953744b7788c10e78d3541473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:27.506728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.509404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.515217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 827/1656] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:27 2022] DELETE /identity/v3/projects/9c79180953744b7788c10e78d3541473 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:27.518933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:27.540932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b459fbe-2449-4d59-ae3d-d1df90e1f66d service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:27.561632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:27.563121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:27.756304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:27.757609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:27.758264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:27.758892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] PATH_INFO: `/v3/users/b8c7b737170c49f0a1a16306b0950b5b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:27.761288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c7b737170c49f0a1a16306b0950b5b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:27.762563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: WARNING py.warnings [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:55:27.762563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: warnings.warn(msg) Aug 24 08:55:27.762563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: Aug 24 08:55:27.764547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:27.784013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77878-2201-484a-beb2-e5f8ab2daf53 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:27.795192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:27.796992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:27.800197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:27.800706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] PATH_INFO: `/v3/users/957be2fd55a04d70a15b4006d472beda` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:27.802873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=957be2fd55a04d70a15b4006d472beda)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:27.806331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:27.868127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:27.919905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c7b737170c49f0a1a16306b0950b5b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.920122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957be2fd55a04d70a15b4006d472beda'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.920812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957be2fd55a04d70a15b4006d472beda'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.921510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957be2fd55a04d70a15b4006d472beda'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.921626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c7b737170c49f0a1a16306b0950b5b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.931632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957be2fd55a04d70a15b4006d472beda'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.950675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-244921ae-771e-47d4-b5dd-a4e331cd0dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957be2fd55a04d70a15b4006d472beda'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.950789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c7b737170c49f0a1a16306b0950b5b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.958086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c7b737170c49f0a1a16306b0950b5b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.983720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c7b737170c49f0a1a16306b0950b5b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:27.994395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 828/1657] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:27 2022] DELETE /identity/v3/users/957be2fd55a04d70a15b4006d472beda => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:27.996087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:27.996358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:27.996685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:28.034748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:28.036314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:28.089353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 830/1658] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:27 2022] DELETE /identity/v3/users/b8c7b737170c49f0a1a16306b0950b5b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:28.180920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 829/1659] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:28.210309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:28.213632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:28.282271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:28.399330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88275689-67c0-40e7-ae5b-e522d756d6c1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:28.413247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804daa83-f041-4c06-8e0c-b47deea14004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:28.413736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804daa83-f041-4c06-8e0c-b47deea14004 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:28.414021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804daa83-f041-4c06-8e0c-b47deea14004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:28.414297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804daa83-f041-4c06-8e0c-b47deea14004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:28.572411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804daa83-f041-4c06-8e0c-b47deea14004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:28.586060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804daa83-f041-4c06-8e0c-b47deea14004 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:28.608516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 831/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:29.923284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:29.925839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:29.950209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e76d5-bcf8-41a5-b134-b05dba80938d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:29.960301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:29.961497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:29.962105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:29.962582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] PATH_INFO: `/v3/projects/8cb1d36be5aa4c95b7afc359db70167e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:29.965889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cb1d36be5aa4c95b7afc359db70167e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:29.982833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:30.125085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cb1d36be5aa4c95b7afc359db70167e', 'request_id': 'req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:30.133442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cb1d36be5aa4c95b7afc359db70167e', 'request_id': 'req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:30.149843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cb1d36be5aa4c95b7afc359db70167e', 'request_id': 'req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:30.165549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] The token cache is being invalidate because project 8cb1d36be5aa4c95b7afc359db70167e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:30.166335 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:30.167674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-803c8d6f-ddf4-4e1e-94ea-18ae731c75cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:30.182887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 830/1661] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:29 2022] DELETE /identity/v3/projects/8cb1d36be5aa4c95b7afc359db70167e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:30.184422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e7e54-4138-4bd2-bd54-0ceada920c89 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:30.184932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e7e54-4138-4bd2-bd54-0ceada920c89 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:30.185188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e7e54-4138-4bd2-bd54-0ceada920c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:30.230878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b70e7e54-4138-4bd2-bd54-0ceada920c89 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:30.233119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b70e7e54-4138-4bd2-bd54-0ceada920c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:30.328164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f8567-3a9f-4c44-b71e-3e34abcd3760 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:30.329424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f8567-3a9f-4c44-b71e-3e34abcd3760 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:30.331088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f8567-3a9f-4c44-b71e-3e34abcd3760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:30.400046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-496f8567-3a9f-4c44-b71e-3e34abcd3760 None None] MFA Rules not processed for user `f0602554c12e4710912338a9ddccbbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:30.401195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-496f8567-3a9f-4c44-b71e-3e34abcd3760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:30.405891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 832/1662] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:30.407699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c08b9-a3b2-4233-8b28-c0115266ef8a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:30.408119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c08b9-a3b2-4233-8b28-c0115266ef8a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:30.408420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c08b9-a3b2-4233-8b28-c0115266ef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:30.443976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:30.468705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-165c08b9-a3b2-4233-8b28-c0115266ef8a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:30.470095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-165c08b9-a3b2-4233-8b28-c0115266ef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:30.480561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 833/1663] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:30.484949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c08b9-a3b2-4233-8b28-c0115266ef8a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:30.533694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c08b9-a3b2-4233-8b28-c0115266ef8a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:30.550960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:30.552068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:30.556337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:30.556923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:30.557857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:30.558452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:30.560905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:30.584962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 834/1664] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:55:30.587035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:30.619194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413c099-0aa1-4857-ab7e-2129caa2cb4a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:30.641468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:30.642669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:30.644281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:30.645038 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:30.647602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:30.653009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 831/1665] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:30.653622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:30.663707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:30.663904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:30.664104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:30.733512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 835/1666] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:30 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:30.743514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] MFA Rules not processed for user `f0602554c12e4710912338a9ddccbbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:30.745249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:30.749997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:30.860695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:30.967544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 832/1667] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:30.972629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f091-8b74-4bd4-96dc-ec528477c671 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:30.974743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:30.976858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:30.985247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:30.986070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:30.986449 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:30.988805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:30.989614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:30.996104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:31.066369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 836/1668] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:30 2022] POST /identity/v3/users => generated 294 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:31.068151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:31.103579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65655-8135-43ea-b8d8-9d527a8abf6c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:31.124346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:31.125482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:31.125866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:31.126365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:31.132576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:31.134299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:31.160116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 837/1669] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:31.167892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:31.202392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25630255-658a-4bb5-830b-f04837ba11fe admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:31.203214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab86892-2798-40aa-a5ab-f3dce4bdc794 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:31.215553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:31.216191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:31.216579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:31.217266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:31.217933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:31.222320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:31.222969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:31.223257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:31.223595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:31.226848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:31.257693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:31.259754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:31.264913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 838/1670] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:31.270032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:31.289711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 833/1671] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:31.321942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f360-7c02-43b3-8221-3e83a2d77306 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:31.340879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a24ab-eda5-498c-815c-3a831bf0823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:31.341789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a24ab-eda5-498c-815c-3a831bf0823e admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:31.342263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a24ab-eda5-498c-815c-3a831bf0823e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:31.342693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a24ab-eda5-498c-815c-3a831bf0823e admin admin] PATH_INFO: `/v3/projects/5ae5d88473f0422e9eab7ee4841113d6/users/e3156a2e3fa64766901c4cc61586f6ad/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:31.381934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a24ab-eda5-498c-815c-3a831bf0823e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae5d88473f0422e9eab7ee4841113d6, user_id=e3156a2e3fa64766901c4cc61586f6ad, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:31.385703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a24ab-eda5-498c-815c-3a831bf0823e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:31.396796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:31.401721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:31.458852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 839/1672] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:31 2022] PUT /identity/v3/projects/5ae5d88473f0422e9eab7ee4841113d6/users/e3156a2e3fa64766901c4cc61586f6ad/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:31.459109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31783e8-8591-4927-938c-948d608a4b2b service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:31.469977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848d99-59e4-4f79-a752-df387d79265f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:31.470272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848d99-59e4-4f79-a752-df387d79265f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:31.471246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848d99-59e4-4f79-a752-df387d79265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:31.607644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:31.617167 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d4848d99-59e4-4f79-a752-df387d79265f None None] MFA Rules not processed for user `e3156a2e3fa64766901c4cc61586f6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:31.622589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d4848d99-59e4-4f79-a752-df387d79265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:31.671430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:31.672093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:31.672787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:31.673093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] PATH_INFO: `/v3/projects/2bbff5049b734eefb34a95486ea55097` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:31.678234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbff5049b734eefb34a95486ea55097)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:31.680485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:31.836296 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbff5049b734eefb34a95486ea55097', 'request_id': 'req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:31.850546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbff5049b734eefb34a95486ea55097', 'request_id': 'req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:31.860884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 840/1673] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:31.865297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4848d99-59e4-4f79-a752-df387d79265f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:31.869217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbff5049b734eefb34a95486ea55097', 'request_id': 'req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:31.892420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4848d99-59e4-4f79-a752-df387d79265f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:31.901991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] The token cache is being invalidate because project 2bbff5049b734eefb34a95486ea55097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:31.904002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:31.906087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d6538397-6563-4a7d-9cf0-1c101e3f8b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:31.909911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 834/1674] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:31 2022] DELETE /identity/v3/projects/2bbff5049b734eefb34a95486ea55097 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:55:31.915492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c18ea6-2f06-4faf-9c44-2a7b74f8d9af None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:31.915927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c18ea6-2f06-4faf-9c44-2a7b74f8d9af None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:31.916299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c18ea6-2f06-4faf-9c44-2a7b74f8d9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:31.965477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a0c18ea6-2f06-4faf-9c44-2a7b74f8d9af None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:31.966732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a0c18ea6-2f06-4faf-9c44-2a7b74f8d9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:32.058273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.059012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.059294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.059568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.060452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.062204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.092708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:32.131484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 835/1675] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:32.132267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 841/1676] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:31 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:55:32.134117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.136683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:32.140505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207c965-baed-4671-a8d1-d0a73a4fb37e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.141004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207c965-baed-4671-a8d1-d0a73a4fb37e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.141427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207c965-baed-4671-a8d1-d0a73a4fb37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.184826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a207c965-baed-4671-a8d1-d0a73a4fb37e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:32.186082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a207c965-baed-4671-a8d1-d0a73a4fb37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:32.290792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3c28f-3531-47e6-855e-acefae327529 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.301024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.301024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.301222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.301624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.303420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.305535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.358273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 836/1677] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:32.365508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 842/1678] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:32 2022] POST /identity/v3/users => generated 300 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:32.367806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207c965-baed-4671-a8d1-d0a73a4fb37e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.367942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.386915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207c965-baed-4671-a8d1-d0a73a4fb37e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.391445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff22f-9106-47aa-ac92-1461dacafb27 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.398673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.399319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.399602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.399881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.400581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.402663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.404062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.404732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.405007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.405326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.405989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:32.406444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.408078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.415217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:32.427838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 837/1679] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:32.432374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.452008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac4b1d-f6a4-4d91-99ea-2e21bc9f2ca2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.456826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 843/1680] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:32.464834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.465532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.465817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.466100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] PATH_INFO: `/v3/projects/93d8097d59de452b8d91bd03e4dbb32a/users/2ecb94a5910248a18b608ea273ab1917/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.468617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.485038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d8097d59de452b8d91bd03e4dbb32a, user_id=2ecb94a5910248a18b608ea273ab1917, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.488285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.491289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078871-08e4-4b86-8a2c-105578c5aa29 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.509100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1d4ec-ecea-478e-9079-84e57763c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.509792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d4ec-ecea-478e-9079-84e57763c298 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.510626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d4ec-ecea-478e-9079-84e57763c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.510626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1d4ec-ecea-478e-9079-84e57763c298 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.512448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1d4ec-ecea-478e-9079-84e57763c298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.514411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1d4ec-ecea-478e-9079-84e57763c298 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.518142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 838/1681] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:32 2022] PUT /identity/v3/projects/93d8097d59de452b8d91bd03e4dbb32a/users/2ecb94a5910248a18b608ea273ab1917/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:32.524374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.583530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 844/1682] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:32 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:32.584968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d7df-f2f0-4d94-a2c3-3ffcefb3c3cd None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.585377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d7df-f2f0-4d94-a2c3-3ffcefb3c3cd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.585658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d7df-f2f0-4d94-a2c3-3ffcefb3c3cd None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.587403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 845/1683] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 24 08:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:32.590216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d7df-f2f0-4d94-a2c3-3ffcefb3c3cd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.638158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5401fc-de90-4ce1-bbc0-425af3226474 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.704801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d7df-f2f0-4d94-a2c3-3ffcefb3c3cd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.712309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac36d43-4275-4320-b8d6-5708e85315ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.713013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac36d43-4275-4320-b8d6-5708e85315ad admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.714593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac36d43-4275-4320-b8d6-5708e85315ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.714876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac36d43-4275-4320-b8d6-5708e85315ad admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.715518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac36d43-4275-4320-b8d6-5708e85315ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.719360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac36d43-4275-4320-b8d6-5708e85315ad admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.753685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 846/1684] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:32 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:32.755431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc100-304d-446d-ae41-f317272c35ee None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.756040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc100-304d-446d-ae41-f317272c35ee None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.757020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefc100-304d-446d-ae41-f317272c35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.760104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.761029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.762338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.762795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.763970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.766143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.788525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 839/1685] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:32.789917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.807895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:32.810112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2aefc100-304d-446d-ae41-f317272c35ee None None] MFA Rules not processed for user `7194e3fe0d2d46ada270bb440cd79911`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:32.811434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2aefc100-304d-446d-ae41-f317272c35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:32.826719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8f152-70c6-4e2a-bf1f-55dd1fa66754 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.836323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:32.840999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.841649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.841927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.842200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] PATH_INFO: `/v3/users/18ecdd63ae2b48e6ba6551eeac8a8bce` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.845503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ecdd63ae2b48e6ba6551eeac8a8bce)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.847433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.927182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 847/1686] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:32.929145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc100-304d-446d-ae41-f317272c35ee None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:32.955542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ecdd63ae2b48e6ba6551eeac8a8bce'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:32.957363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ecdd63ae2b48e6ba6551eeac8a8bce'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:32.958708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ecdd63ae2b48e6ba6551eeac8a8bce'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:32.965051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefc100-304d-446d-ae41-f317272c35ee None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:32.982141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:32.982779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:32.983057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:32.983325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:32.984026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:32.986393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ecdd63ae2b48e6ba6551eeac8a8bce'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:32.992688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:32.998631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ecdd63ae2b48e6ba6551eeac8a8bce'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:33.010861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:33.016799 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 848/1687] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:33.018276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:33.025205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.030314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 840/1688] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:32 2022] DELETE /identity/v3/users/18ecdd63ae2b48e6ba6551eeac8a8bce => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:33.035638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:33.037974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.056992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6787cb7-64fd-48cb-8d45-cdfe5d3cb090 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:33.157552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:33.158346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.158852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.159209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] PATH_INFO: `/v3/projects/93d8097d59de452b8d91bd03e4dbb32a/users/2ecb94a5910248a18b608ea273ab1917/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.165039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d8097d59de452b8d91bd03e4dbb32a, user_id=2ecb94a5910248a18b608ea273ab1917, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:33.168394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:33.193224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 849/1689] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:33 2022] PUT /identity/v3/projects/93d8097d59de452b8d91bd03e4dbb32a/users/2ecb94a5910248a18b608ea273ab1917/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:33.194628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:33.196509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.237621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955f15f-0f82-421b-bffe-7e2400e840ca admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:33.340666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae179fd-cb16-477f-95c8-d103b9555229 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:33.353762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bacec5-6f4e-46f7-9b7a-5d0cfdd61bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:33.354634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bacec5-6f4e-46f7-9b7a-5d0cfdd61bee admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.355033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bacec5-6f4e-46f7-9b7a-5d0cfdd61bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.355419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bacec5-6f4e-46f7-9b7a-5d0cfdd61bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.356298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bacec5-6f4e-46f7-9b7a-5d0cfdd61bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:33.358880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bacec5-6f4e-46f7-9b7a-5d0cfdd61bee admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:33.384796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 850/1690] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:33.386470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615111-1126-4e12-a6c6-e405b60426fc None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.387276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:33.387974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.388207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.388593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.388810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615111-1126-4e12-a6c6-e405b60426fc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.389220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615111-1126-4e12-a6c6-e405b60426fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.390526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.415893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:33.417445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:33.432818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9e615111-1126-4e12-a6c6-e405b60426fc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:33.434458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9e615111-1126-4e12-a6c6-e405b60426fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.451849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 851/1691] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:33.453232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446af9a-e336-40b4-8ed2-688c0bf48338 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.453525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446af9a-e336-40b4-8ed2-688c0bf48338 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.453806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446af9a-e336-40b4-8ed2-688c0bf48338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.468784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 841/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:33.470097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:33.487337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a476ec0-af27-4a76-bda4-f709e327f4b4 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:33.497646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:33.498578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.499430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.499935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] PATH_INFO: `/v3/projects/1acd81313a324d9d9ba8616341713aa9/users/bc040538d8734de0ab2457f82c5b813f/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.521818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8446af9a-e336-40b4-8ed2-688c0bf48338 None None] MFA Rules not processed for user `2ecb94a5910248a18b608ea273ab1917`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:33.528073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8446af9a-e336-40b4-8ed2-688c0bf48338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.557456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1acd81313a324d9d9ba8616341713aa9, user_id=bc040538d8734de0ab2457f82c5b813f, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:33.571197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:33.625208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 842/1693] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:33 2022] PUT /identity/v3/projects/1acd81313a324d9d9ba8616341713aa9/users/bc040538d8734de0ab2457f82c5b813f/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:33.625208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:33.635808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:33.735460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f15f0f-c23e-4cc9-8bb7-882aeb534627 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:33.745531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:33.746668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.747027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.747508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.756232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 852/1694] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:33.765160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad43b9-4a75-4558-97dd-8b1ef61851a8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.765455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad43b9-4a75-4558-97dd-8b1ef61851a8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.765735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad43b9-4a75-4558-97dd-8b1ef61851a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:33.812591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:33.836050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-73ad43b9-4a75-4558-97dd-8b1ef61851a8 None None] MFA Rules not processed for user `bc040538d8734de0ab2457f82c5b813f`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:33.838035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-73ad43b9-4a75-4558-97dd-8b1ef61851a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.867727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:33.869245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:33.883156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 843/1695] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:33.884217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:33.885590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:33.962973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 853/1696] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:33.970192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad43b9-4a75-4558-97dd-8b1ef61851a8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:33.988691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940792d-880c-46e1-b056-33ada6c545cb service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:33.993274 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9df1a-d705-4c9b-b13c-76213e76af01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:33.993889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9df1a-d705-4c9b-b13c-76213e76af01 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:33.994171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9df1a-d705-4c9b-b13c-76213e76af01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:33.994443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9df1a-d705-4c9b-b13c-76213e76af01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.000921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad43b9-4a75-4558-97dd-8b1ef61851a8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:34.016432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:34.017255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.017550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.018005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.019940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:34.024023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:34.095605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 854/1697] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:33 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:55:34.100061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:34.165562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9df1a-d705-4c9b-b13c-76213e76af01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:34.169466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9df1a-d705-4c9b-b13c-76213e76af01 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:34.201088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 844/1698] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:34.206188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516126-c782-4241-bf58-68b0e0bba15b None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.206483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516126-c782-4241-bf58-68b0e0bba15b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.206753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516126-c782-4241-bf58-68b0e0bba15b None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.211743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 845/1699] 10.222.0.42 () {54 vars in 961 bytes} [Wed Aug 24 08:55:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:34.213802 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.214082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.214361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.309060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4331f-ed41-4dbe-ae2e-c8ae50d9cdc9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:34.316575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:34.317628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.318039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.318591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.319508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:34.323430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:34.331951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:34.334417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:34.357610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 855/1700] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:34 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:34.358208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:34.372686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff8145-e080-4788-9271-047161f067c1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:34.387445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:34.388345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.388897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.389715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] PATH_INFO: `/v3/users/e3156a2e3fa64766901c4cc61586f6ad` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.391066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3156a2e3fa64766901c4cc61586f6ad)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:34.393473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:34.415358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:34.488286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3156a2e3fa64766901c4cc61586f6ad'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:34.494901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3156a2e3fa64766901c4cc61586f6ad'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:34.504822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3156a2e3fa64766901c4cc61586f6ad'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:34.505599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3156a2e3fa64766901c4cc61586f6ad'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:34.523426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b67996f3-ce96-4007-8f72-295c8e8f16cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3156a2e3fa64766901c4cc61586f6ad'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:34.544168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 846/1701] 10.222.0.42 () {58 vars in 1058 bytes} [Wed Aug 24 08:55:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:34.545106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:34.558563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:34.598158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 856/1702] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:34 2022] DELETE /identity/v3/users/e3156a2e3fa64766901c4cc61586f6ad => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:34.599855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773ccb-d855-479a-baec-841cb40a8135 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.601184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773ccb-d855-479a-baec-841cb40a8135 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.601674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773ccb-d855-479a-baec-841cb40a8135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.603422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fe649-e0a6-4c79-a374-2c8c8e7160e4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:34.668075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:34.682542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9c773ccb-d855-479a-baec-841cb40a8135 None None] MFA Rules not processed for user `f0602554c12e4710912338a9ddccbbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:34.683788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9c773ccb-d855-479a-baec-841cb40a8135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:34.779350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:34.783630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.784172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.786766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.790171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:34.797301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:34.811918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 847/1703] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:34.813182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:34.815586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 857/1704] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:34.820561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1364b-c1b0-438d-9b39-16b2e4bb92e6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.820561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1364b-c1b0-438d-9b39-16b2e4bb92e6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.820561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1364b-c1b0-438d-9b39-16b2e4bb92e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.885119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1ee1364b-c1b0-438d-9b39-16b2e4bb92e6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:34.886712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ee1364b-c1b0-438d-9b39-16b2e4bb92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:34.903187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 858/1705] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:34.903187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1364b-c1b0-438d-9b39-16b2e4bb92e6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:34.921204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1364b-c1b0-438d-9b39-16b2e4bb92e6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:34.929870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:34.930808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.931340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.931880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] PATH_INFO: `/v3/projects/570613cb3ea14c54a76ef62c9a98721e/users/154ac2468ae84092b81672164fa55656/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.942413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b1ae-413a-402a-94c6-f0b6ef6e517c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:34.959792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:34.960352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:34.960796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:34.961084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:34.965379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:34.966492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=570613cb3ea14c54a76ef62c9a98721e, user_id=154ac2468ae84092b81672164fa55656, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:34.974362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:34.994662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:34.996435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:35.002871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 859/1706] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:34 2022] PUT /identity/v3/projects/570613cb3ea14c54a76ef62c9a98721e/users/154ac2468ae84092b81672164fa55656/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:35.002871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:35.004797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:35.027948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 848/1707] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:35.029210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:35.036928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:35.070250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8182-c32d-46b9-8cc9-16be1f61724a service placement] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:35.210292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:35.211381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:35.211381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:35.211574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] PATH_INFO: `/v3/users/33e436cd09274025be98e422634300ba` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:35.215692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e436cd09274025be98e422634300ba)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:35.217861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:35.219554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1a9e4-1f12-49d9-8059-3e496eb22712 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:35.229012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:35.230557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:35.231011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:35.231302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:35.258842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:35.265771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:35.304160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 860/1708] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:35.305906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:35.320339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332748cb-fdc3-4321-a385-bfe5baa692de service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:35.326891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:35.327919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:35.328689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:35.329265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:35.330188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:35.332275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:35.332505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e436cd09274025be98e422634300ba'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.333162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e436cd09274025be98e422634300ba'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.333823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e436cd09274025be98e422634300ba'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.335595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:35.347375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:35.354352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e436cd09274025be98e422634300ba'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.365835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 861/1709] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:35.368492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:35.372179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f890c633-1f37-4e5e-b6e1-a7a2c2029221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e436cd09274025be98e422634300ba'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.377091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:35.413710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7d3f8-6ca3-4074-8ad7-b2bde572f191 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:35.423383 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 849/1710] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:35 2022] DELETE /identity/v3/users/33e436cd09274025be98e422634300ba => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:35.426279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e09554-280a-417f-ad92-5645e25b887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:35.428334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:35.428807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:35.429249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:35.431145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09554-280a-417f-ad92-5645e25b887e admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:35.432675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09554-280a-417f-ad92-5645e25b887e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:35.433124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09554-280a-417f-ad92-5645e25b887e admin admin] PATH_INFO: `/v3/projects/570613cb3ea14c54a76ef62c9a98721e/users/154ac2468ae84092b81672164fa55656/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:35.437116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e09554-280a-417f-ad92-5645e25b887e admin admin] RBAC: Authorizing `identity:create_grant(project_id=570613cb3ea14c54a76ef62c9a98721e, user_id=154ac2468ae84092b81672164fa55656, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:35.446317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e09554-280a-417f-ad92-5645e25b887e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:35.478086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 862/1711] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:35 2022] PUT /identity/v3/projects/570613cb3ea14c54a76ef62c9a98721e/users/154ac2468ae84092b81672164fa55656/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:35.479436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:35.481741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:35.490207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:35.491686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:35.492129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:35.553016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] MFA Rules not processed for user `154ac2468ae84092b81672164fa55656`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:35.554272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:35.651654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 850/1712] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:35.651654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:35.653540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:35.684563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936143c-5f21-4821-bdc9-84c4b95f1731 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:35.701413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:35.703359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:35.703934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:35.703934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] PATH_INFO: `/v3/projects/0063578905ee4b05ab4cc9c7bd28462b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:35.706397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0063578905ee4b05ab4cc9c7bd28462b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:35.711861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:35.717450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 863/1713] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:35.730673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:35.732536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:35.869354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0063578905ee4b05ab4cc9c7bd28462b', 'request_id': 'req-67370aa7-2f56-487c-9907-3c2f5d86ced6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.882442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0063578905ee4b05ab4cc9c7bd28462b', 'request_id': 'req-67370aa7-2f56-487c-9907-3c2f5d86ced6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.887739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21208581-15f4-4d83-9387-57092e4b1096 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:35.896952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0063578905ee4b05ab4cc9c7bd28462b', 'request_id': 'req-67370aa7-2f56-487c-9907-3c2f5d86ced6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.959044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] The token cache is being invalidate because project 0063578905ee4b05ab4cc9c7bd28462b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:35.962394 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.966941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:35.975265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 851/1714] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:35 2022] DELETE /identity/v3/projects/0063578905ee4b05ab4cc9c7bd28462b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:35.977905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:35.982723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:36.125320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:36.125970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:36.126253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:36.126528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:36.130935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:36.147759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:36.153905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67370aa7-2f56-487c-9907-3c2f5d86ced6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:36.161051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:36.162360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:36.162865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:36.164011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:36.167342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:36.244410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:36.296015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:36.299407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:36.326472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:36.349873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 864/1715] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:55:36.350709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:36.353196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:36.361602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:36.416620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 852/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:36.432477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c13a-a884-4cc6-aaf2-42164479618f service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:36.446353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:36.447456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:36.448108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:36.448633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] PATH_INFO: `/v3/users/d4b0980b5ae64e09964b6b716489e6a7` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:36.453454 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b0980b5ae64e09964b6b716489e6a7)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:36.455910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:36.584617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b0980b5ae64e09964b6b716489e6a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:36.586698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b0980b5ae64e09964b6b716489e6a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:36.610870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b0980b5ae64e09964b6b716489e6a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:36.613428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b0980b5ae64e09964b6b716489e6a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:36.633130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b0980b5ae64e09964b6b716489e6a7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:36.709678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 865/1717] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:36 2022] DELETE /identity/v3/users/d4b0980b5ae64e09964b6b716489e6a7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:37.013685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:37.015360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:37.054104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fccb0c-125e-4187-b285-a337cd129316 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:37.135555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:37.141984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:37.339011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:37.339701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:37.340000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:37.340278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] PATH_INFO: `/v3/projects/cee109db5d084b15b58e6ae9fbadb659` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:37.355055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee109db5d084b15b58e6ae9fbadb659)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:37.365962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:37.398812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb873bb-558b-4f1a-b47e-b6deecc1ca0a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:37.412123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:37.412816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:37.413379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:37.413379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] PATH_INFO: `/v3/projects/5ae5d88473f0422e9eab7ee4841113d6` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:37.414997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae5d88473f0422e9eab7ee4841113d6)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:37.427711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:37.497124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee109db5d084b15b58e6ae9fbadb659', 'request_id': 'req-13bbc97b-a881-4983-afe3-0268a33e66fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.515345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee109db5d084b15b58e6ae9fbadb659', 'request_id': 'req-13bbc97b-a881-4983-afe3-0268a33e66fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.534393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee109db5d084b15b58e6ae9fbadb659', 'request_id': 'req-13bbc97b-a881-4983-afe3-0268a33e66fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.545675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae5d88473f0422e9eab7ee4841113d6', 'request_id': 'req-9658329b-405e-4500-a56c-f9c292d5736a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.551610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:37.553097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae5d88473f0422e9eab7ee4841113d6', 'request_id': 'req-9658329b-405e-4500-a56c-f9c292d5736a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.565374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae5d88473f0422e9eab7ee4841113d6', 'request_id': 'req-9658329b-405e-4500-a56c-f9c292d5736a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.570701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] The token cache is being invalidate because project cee109db5d084b15b58e6ae9fbadb659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:37.571000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.572539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.596907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 853/1718] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:37 2022] DELETE /identity/v3/projects/cee109db5d084b15b58e6ae9fbadb659 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:55:37.600491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:37.601946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] The token cache is being invalidate because project 5ae5d88473f0422e9eab7ee4841113d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:37.602359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.603052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.604148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:37.607462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 866/1719] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:37 2022] DELETE /identity/v3/projects/5ae5d88473f0422e9eab7ee4841113d6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:37.609099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:37.610592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:37.715422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:37.801086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658329b-405e-4500-a56c-f9c292d5736a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:37.813845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:37.814785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:37.815214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:37.815634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] PATH_INFO: `/v3/users/2ecb94a5910248a18b608ea273ab1917` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:37.818870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecb94a5910248a18b608ea273ab1917)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:37.824300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:37.856670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc97b-a881-4983-afe3-0268a33e66fd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:37.872862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:37.874640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:37.874906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:37.884901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] PATH_INFO: `/v3/users/523a772c2df24f43b46f254d584abc1a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:37.888915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523a772c2df24f43b46f254d584abc1a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:37.892888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:37.930572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecb94a5910248a18b608ea273ab1917'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.933229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecb94a5910248a18b608ea273ab1917'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.951965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecb94a5910248a18b608ea273ab1917'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.953627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecb94a5910248a18b608ea273ab1917'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:37.969298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecb94a5910248a18b608ea273ab1917'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:38.035079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 867/1720] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:37 2022] DELETE /identity/v3/users/2ecb94a5910248a18b608ea273ab1917 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:38.076025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523a772c2df24f43b46f254d584abc1a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:38.076665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523a772c2df24f43b46f254d584abc1a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:38.079430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523a772c2df24f43b46f254d584abc1a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:38.108864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523a772c2df24f43b46f254d584abc1a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:38.124744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9d3c74b7-68d1-413d-8dde-136c73c0e031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523a772c2df24f43b46f254d584abc1a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:38.174243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 854/1721] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:37 2022] DELETE /identity/v3/users/523a772c2df24f43b46f254d584abc1a => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:38.366528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:38.368245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:38.539916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682bb05-24ac-4329-b1e0-5a1b2c9f04d6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:38.599680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:38.697028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:38.697656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:38.697937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:38.698689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:38.705324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:38.928304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:38.930801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:38.979494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 868/1722] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:39.091439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:39.092018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:39.092018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:39.269573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:39.270929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:39.458631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 855/1723] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:55:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:39.819346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:39.821478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:40.170986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c80b8a-d7d6-4994-a473-dc198c59126d service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:40.182492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00aadd-ea0e-4480-8eb3-371b043b7fae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:40.183457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00aadd-ea0e-4480-8eb3-371b043b7fae service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:40.183662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00aadd-ea0e-4480-8eb3-371b043b7fae service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:40.183941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00aadd-ea0e-4480-8eb3-371b043b7fae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:40.202657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00aadd-ea0e-4480-8eb3-371b043b7fae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:40.204301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00aadd-ea0e-4480-8eb3-371b043b7fae service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:40.207915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:40.209742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:40.251291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 869/1724] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:55:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:55:40.276835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:40.462799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15463531-3ee4-4df9-b896-07c1e0ac60d4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:40.481129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:40.482015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:40.482323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:40.482602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] PATH_INFO: `/v3/projects/ac37179bd4bf49e1875741c63b8010ca` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:40.495290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac37179bd4bf49e1875741c63b8010ca)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:40.498264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:40.728448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac37179bd4bf49e1875741c63b8010ca', 'request_id': 'req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:40.757567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac37179bd4bf49e1875741c63b8010ca', 'request_id': 'req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:40.784979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac37179bd4bf49e1875741c63b8010ca', 'request_id': 'req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:40.852604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] The token cache is being invalidate because project ac37179bd4bf49e1875741c63b8010ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:40.852904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:40.859433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bd6ebdeb-bd1e-4a9f-98f8-17dbfa6924a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:40.862754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 856/1725] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:40 2022] DELETE /identity/v3/projects/ac37179bd4bf49e1875741c63b8010ca => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:55:40.869409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15328f-9b85-4eec-a6dd-0a7636bffb19 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:40.870506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15328f-9b85-4eec-a6dd-0a7636bffb19 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:40.871348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15328f-9b85-4eec-a6dd-0a7636bffb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:40.937083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8a15328f-9b85-4eec-a6dd-0a7636bffb19 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:40.943651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8a15328f-9b85-4eec-a6dd-0a7636bffb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:41.096841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:41.208905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 870/1726] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:55:41.222639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910cb4-4fe9-47fd-832e-e83f46ce2a99 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:41.222639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910cb4-4fe9-47fd-832e-e83f46ce2a99 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:41.222639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910cb4-4fe9-47fd-832e-e83f46ce2a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:41.271166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d0910cb4-4fe9-47fd-832e-e83f46ce2a99 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:41.276227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d0910cb4-4fe9-47fd-832e-e83f46ce2a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:41.311754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 857/1727] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:41.313890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15328f-9b85-4eec-a6dd-0a7636bffb19 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:41.330209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15328f-9b85-4eec-a6dd-0a7636bffb19 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:41.343377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:41.381455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:41.385802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:41.386741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:41.391526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:41.393086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:41.401415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:41.458654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 871/1728] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:41.459294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0910cb4-4fe9-47fd-832e-e83f46ce2a99 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:41.489663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0910cb4-4fe9-47fd-832e-e83f46ce2a99 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:41.524872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:41.525364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:41.528286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:41.528616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:41.533226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:41.541774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:41.644280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:41.649026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:41.671020 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 858/1729] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:41.671918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:41.673701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:41.698151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ee95b-dd6e-4c7f-b057-ee853aa6d43a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:41.875407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20d47b-fe28-4d52-ab17-c8211d615db3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:41.893144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:41.893847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:41.894153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:41.894542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] PATH_INFO: `/v3/projects/677794e4ad7447e79116b6adefeedfaa` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:41.897132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=677794e4ad7447e79116b6adefeedfaa)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:41.899354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:41.921664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:41.924878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:41.927497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:41.930364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] PATH_INFO: `/v3/projects/93d8097d59de452b8d91bd03e4dbb32a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:41.935663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d8097d59de452b8d91bd03e4dbb32a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:41.948985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:41.996245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:42.059725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '677794e4ad7447e79116b6adefeedfaa', 'request_id': 'req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.073737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '677794e4ad7447e79116b6adefeedfaa', 'request_id': 'req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.096812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '677794e4ad7447e79116b6adefeedfaa', 'request_id': 'req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.132715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] The token cache is being invalidate because project 677794e4ad7447e79116b6adefeedfaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:42.132935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.135899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.141602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 859/1730] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:41 2022] DELETE /identity/v3/projects/677794e4ad7447e79116b6adefeedfaa => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:42.141807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d8097d59de452b8d91bd03e4dbb32a', 'request_id': 'req-b43443dd-9f51-43ac-9c62-9ab789b574df'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.143817 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:42.150099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:42.154331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d8097d59de452b8d91bd03e4dbb32a', 'request_id': 'req-b43443dd-9f51-43ac-9c62-9ab789b574df'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.171417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d8097d59de452b8d91bd03e4dbb32a', 'request_id': 'req-b43443dd-9f51-43ac-9c62-9ab789b574df'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.223338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] The token cache is being invalidate because project 93d8097d59de452b8d91bd03e4dbb32a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:42.223886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.251586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b43443dd-9f51-43ac-9c62-9ab789b574df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:42.254217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 872/1731] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:41 2022] DELETE /identity/v3/projects/93d8097d59de452b8d91bd03e4dbb32a => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:42.255525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2721d99-6fc0-49ec-8496-e57f8d37bd3c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.255816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2721d99-6fc0-49ec-8496-e57f8d37bd3c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.256096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2721d99-6fc0-49ec-8496-e57f8d37bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.312010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b2721d99-6fc0-49ec-8496-e57f8d37bd3c None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:42.321777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b2721d99-6fc0-49ec-8496-e57f8d37bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:42.385770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998d9ea-b628-4ca7-90a7-3a5a3f6673bf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:42.461177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:42.496898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 873/1732] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:42.496898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a52b-14b7-44b2-8662-a3895c944a4d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.496898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a52b-14b7-44b2-8662-a3895c944a4d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.496898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a52b-14b7-44b2-8662-a3895c944a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.538373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f914a52b-14b7-44b2-8662-a3895c944a4d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:42.539608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f914a52b-14b7-44b2-8662-a3895c944a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:42.570219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 874/1733] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:42.573204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.573204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.573204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.585672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b3c79-dff4-4aca-9d29-cd2627c316cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:42.585996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b3c79-dff4-4aca-9d29-cd2627c316cf admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.588241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b3c79-dff4-4aca-9d29-cd2627c316cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.588579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b3c79-dff4-4aca-9d29-cd2627c316cf admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.589238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b3c79-dff4-4aca-9d29-cd2627c316cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:42.605649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b3c79-dff4-4aca-9d29-cd2627c316cf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:42.670246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 860/1734] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:42 2022] POST /identity/v3/users => generated 289 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:42.674158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463c65-b2d9-4c09-a559-8c92a7cf9fb6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.674707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463c65-b2d9-4c09-a559-8c92a7cf9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.675314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41463c65-b2d9-4c09-a559-8c92a7cf9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.676646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:42.679937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:42.719461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 875/1735] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:42.720421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:42.724443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:42.729442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-41463c65-b2d9-4c09-a559-8c92a7cf9fb6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:42.731040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-41463c65-b2d9-4c09-a559-8c92a7cf9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:42.770649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0855-d740-4c05-a524-555c89a385d7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:42.771861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 861/1736] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:42.773053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41463c65-b2d9-4c09-a559-8c92a7cf9fb6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:42.800809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41463c65-b2d9-4c09-a559-8c92a7cf9fb6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:42.807631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:42.808461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.808860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.809654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.810534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:42.810963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:42.813544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:42.819770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:42.820424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.823254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.823551 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.824250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:42.834323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:42.855392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 862/1737] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:42.856743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:42.907976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e087e-02f3-45f8-8839-6d3d2c00f956 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:42.909837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 876/1738] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:42.913462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:42.938595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:42.939394 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:42.939793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:42.940198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:42.941190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:42.941632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:42.943548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:42.981602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db2fee-ef87-4340-b402-2cfbca4ce584 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:42.985207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 863/1739] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:42.986639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:43.006029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:43.010095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:43.010403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:43.010690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:43.017473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed884-86bf-4524-8157-2f6accf50e6d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:43.024208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:43.050451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:43.052601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:43.053408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:43.053980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:43.054454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:43.055194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:43.057158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:43.119674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 864/1740] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:43.120745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:43.141841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:43.146876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f4d3-44dd-4a97-b3a4-52c5b2126f0c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:43.168025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:43.168881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:43.169785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:43.170230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:43.171399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:43.173887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:43.237659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 877/1741] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:42 2022] POST /identity/v3/projects => generated 367 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:43.242133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:43.286787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 865/1742] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:43 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:43.288175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:43.507192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302edf-cc3c-4fd6-b10e-df41e9fcf8f9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:43.566940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732546e-2db3-49bb-a453-afc9cb238ec2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:43.616750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:43.617519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:43.617908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:43.621565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:43.625449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:43.642737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:43.738907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 866/1743] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:43 2022] POST /identity/v3/users => generated 284 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:43.743936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:43.774511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:43.778994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:43.779289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:43.780238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] PATH_INFO: `/v3/projects/ab8cabaea4bf4651a609712c2e43823f/users/9f540e751c8d4d058939e97b78d96d60/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:43.796402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9541-eece-4227-8509-1882a5e48995 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:43.811687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:43.815471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:43.815766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:43.817765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:43.820877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:43.828207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:43.843822 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8cabaea4bf4651a609712c2e43823f, user_id=9f540e751c8d4d058939e97b78d96d60, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:43.854966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:43.901034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 867/1744] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:43 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:43.905070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:43.916740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 878/1745] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:43 2022] PUT /identity/v3/projects/ab8cabaea4bf4651a609712c2e43823f/users/9f540e751c8d4d058939e97b78d96d60/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:43.920611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:43.968487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3406b-1bd0-4853-aedd-aca69234df03 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:44.106675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:44.143530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5bc43-cf4d-475a-bd06-cbeb1a1b0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:44.144841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5bc43-cf4d-475a-bd06-cbeb1a1b0f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:44.145323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5bc43-cf4d-475a-bd06-cbeb1a1b0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:44.145609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5bc43-cf4d-475a-bd06-cbeb1a1b0f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:44.146290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5bc43-cf4d-475a-bd06-cbeb1a1b0f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:44.149313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5bc43-cf4d-475a-bd06-cbeb1a1b0f78 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:44.160461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3c984-ce08-4d96-a5df-bda641888241 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:44.180748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:44.181484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:44.181695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:44.182312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:44.182630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:44.191225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:44.198841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 868/1746] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:44.213150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e331c-46d3-486a-8383-8298805e9885 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:44.214417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e331c-46d3-486a-8383-8298805e9885 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:44.216115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e331c-46d3-486a-8383-8298805e9885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:44.232764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 879/1747] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:44.234926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:44.261452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a37a-a277-4df5-baa4-c7b6faf4a9e1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:44.274718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:44.275448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:44.275794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:44.276162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:44.277189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:44.283382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:44.338611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 880/1748] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:44.340133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:44.351995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ae5e331c-46d3-486a-8383-8298805e9885 None None] MFA Rules not processed for user `9f540e751c8d4d058939e97b78d96d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:44.357740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ae5e331c-46d3-486a-8383-8298805e9885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:44.404753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c49d0e-d60a-4e07-a276-ebea20ccb7a8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:44.430548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:44.433124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:44.434760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:44.435698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:44.443294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:44.456009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:44.508192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 881/1749] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:44.509378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:44.514247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:44.544102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a257c7-60c0-42f9-846f-2145c1c44cce admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:44.551035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:44.552010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:44.552484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:44.552931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] PATH_INFO: `/v3/users/bc040538d8734de0ab2457f82c5b813f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:44.554339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc040538d8734de0ab2457f82c5b813f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:44.556571 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:44.561764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:44.666411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc040538d8734de0ab2457f82c5b813f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:44.667421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc040538d8734de0ab2457f82c5b813f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:44.696943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc040538d8734de0ab2457f82c5b813f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:44.700582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 869/1750] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:44.700582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e331c-46d3-486a-8383-8298805e9885 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:44.702684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc040538d8734de0ab2457f82c5b813f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:44.715742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc040538d8734de0ab2457f82c5b813f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:44.742348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e331c-46d3-486a-8383-8298805e9885 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:44.775944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:44.776836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:44.777198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:44.785128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] PATH_INFO: `/v3/projects/612322e852f04e3c9abca86a1ede97ff/users/81999237dc704cdaa8ad5bf9d0212db1/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:44.807197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 882/1751] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:44 2022] DELETE /identity/v3/users/bc040538d8734de0ab2457f82c5b813f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:44.808220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:44.811392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:44.836011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612322e852f04e3c9abca86a1ede97ff, user_id=81999237dc704cdaa8ad5bf9d0212db1, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:44.840021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:44.904776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 870/1752] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:44 2022] PUT /identity/v3/projects/612322e852f04e3c9abca86a1ede97ff/users/81999237dc704cdaa8ad5bf9d0212db1/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:44.906082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:44.910085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.130643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb631ed-b921-4ffc-972e-960a90b27543 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:45.133094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44307e1f-673e-4b9b-a123-ba31b60ad894 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:45.143499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032c9c4-5111-4bd2-a8db-731c4a25d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:45.144367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032c9c4-5111-4bd2-a8db-731c4a25d2de admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.144711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032c9c4-5111-4bd2-a8db-731c4a25d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.144973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032c9c4-5111-4bd2-a8db-731c4a25d2de admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.145622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032c9c4-5111-4bd2-a8db-731c4a25d2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:45.146080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fac756-0529-4971-bf84-79000c881c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:45.151621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032c9c4-5111-4bd2-a8db-731c4a25d2de admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:45.153943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac756-0529-4971-bf84-79000c881c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.154593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac756-0529-4971-bf84-79000c881c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.156147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fac756-0529-4971-bf84-79000c881c59 admin admin] PATH_INFO: `/v3/projects/fafd2f8e1dd3403a894e901b3a5f5a27/users/4966579b3b3445ef93be8cb126671be7/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.222991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fac756-0529-4971-bf84-79000c881c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafd2f8e1dd3403a894e901b3a5f5a27, user_id=4966579b3b3445ef93be8cb126671be7, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:45.227216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fac756-0529-4971-bf84-79000c881c59 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:45.252940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 871/1753] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:44 2022] POST /identity/v3/projects => generated 377 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:45.254990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ccde0-00ff-4761-8382-3d65ebe052a0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.256899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 883/1754] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:44 2022] PUT /identity/v3/projects/fafd2f8e1dd3403a894e901b3a5f5a27/users/4966579b3b3445ef93be8cb126671be7/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:45.259729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11585904-f4b8-4cef-9f9a-21d68c128d3a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.260034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11585904-f4b8-4cef-9f9a-21d68c128d3a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.260342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11585904-f4b8-4cef-9f9a-21d68c128d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.261729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ccde0-00ff-4761-8382-3d65ebe052a0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.262043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ccde0-00ff-4761-8382-3d65ebe052a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.308803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:45.333126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-11585904-f4b8-4cef-9f9a-21d68c128d3a None None] MFA Rules not processed for user `81999237dc704cdaa8ad5bf9d0212db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:45.336920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d04ccde0-00ff-4761-8382-3d65ebe052a0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:45.337771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-11585904-f4b8-4cef-9f9a-21d68c128d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.342090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d04ccde0-00ff-4761-8382-3d65ebe052a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.483674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 872/1755] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:45.485021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb3d46-2bd9-48ef-b04e-f163da2d6dbc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.485317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb3d46-2bd9-48ef-b04e-f163da2d6dbc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.490852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb3d46-2bd9-48ef-b04e-f163da2d6dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.523333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 884/1756] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:45.524827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11585904-f4b8-4cef-9f9a-21d68c128d3a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:45.546707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-14cb3d46-2bd9-48ef-b04e-f163da2d6dbc None None] MFA Rules not processed for user `a42d659ce7bb4946bd082a07d9339e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:45.548030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-14cb3d46-2bd9-48ef-b04e-f163da2d6dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.549357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11585904-f4b8-4cef-9f9a-21d68c128d3a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:45.558727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93051f72-44d3-40e1-825f-979eedb5e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:45.560905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051f72-44d3-40e1-825f-979eedb5e463 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.561865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051f72-44d3-40e1-825f-979eedb5e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.563035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93051f72-44d3-40e1-825f-979eedb5e463 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.564681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93051f72-44d3-40e1-825f-979eedb5e463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:45.568219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93051f72-44d3-40e1-825f-979eedb5e463 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:45.625878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:45.643910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 885/1757] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:45 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:45.648264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.649628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.650915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.715882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 873/1758] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:45.717176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.717467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.717775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.737217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] MFA Rules not processed for user `4966579b3b3445ef93be8cb126671be7`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:45.741028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.773525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] MFA Rules not processed for user `7194e3fe0d2d46ada270bb440cd79911`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:45.774902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.922009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 874/1759] 10.222.0.71 () {58 vars in 1015 bytes} [Wed Aug 24 08:55:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:45.923051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:45.924685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.949987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963d9ee-d4f5-4d05-89da-0fbb082a5534 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:45.956281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:45.957186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:45.957584 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:45.957955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:45.984025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 886/1760] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:45.985029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:45.987900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:45.990521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:45.994909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.007790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898f878-1243-435a-946b-efbdbadc17e5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.013819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:46.014878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.015130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.015406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:46.016234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:46.018274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.030047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 875/1761] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:46.030047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:46.055017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006bd9d-07dc-424e-b8af-518850aed235 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.074563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:46.075414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.075705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.075977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:46.077365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:46.079308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.111660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 887/1762] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:45 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:46.113627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:46.118524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:46.123678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 876/1763] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:46.124932 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:46.150295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbbb4-0a56-4b12-8f5d-e8449a7d3210 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.271482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:46.326236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:46.326861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.327143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.327789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:46.340994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:46.342699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.353100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 877/1764] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:46.357915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:46.358226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0ffa7-8cc1-40c7-a6df-3286d44b028b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.388981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:46.390019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.392722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.393270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:46.495160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04c28-888b-4436-90e9-9189f89e63d5 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.503748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:46.504409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.504915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.505245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:46.505980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:46.508356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.515277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:46.543226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:46.546972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.598974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 888/1765] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:46.599780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 878/1766] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:46 2022] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:46.600772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:46.605019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:46.642827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94c708-242c-459f-85f5-9f4c06b2b8f1 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.856632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:46.859515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.872405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23865a5-a5c2-4473-ae13-2b3caace4807 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.873885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.879125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:46.880473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:46.882902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.887988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c6ea6-fded-4b1b-a3b8-e78ab6c8857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:46.888865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6ea6-fded-4b1b-a3b8-e78ab6c8857b admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.889230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6ea6-fded-4b1b-a3b8-e78ab6c8857b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.889724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6ea6-fded-4b1b-a3b8-e78ab6c8857b admin admin] PATH_INFO: `/v3/projects/1d294061a16140bca2334ea75ae716e9/users/d41f5e8e036e49e5bc9773b1559078c7/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:46.919370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c6ea6-fded-4b1b-a3b8-e78ab6c8857b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d294061a16140bca2334ea75ae716e9, user_id=d41f5e8e036e49e5bc9773b1559078c7, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:46.935541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 889/1767] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:46 2022] POST /identity/v3/users => generated 291 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:46.937848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:46.951401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c6ea6-fded-4b1b-a3b8-e78ab6c8857b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:46.972022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afd364-4ad1-4417-8576-e24dc3482207 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:46.985675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 879/1768] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:46 2022] PUT /identity/v3/projects/1d294061a16140bca2334ea75ae716e9/users/d41f5e8e036e49e5bc9773b1559078c7/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:46.992937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b13b1-1584-4e35-890e-52c931d358dc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:46.994060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b13b1-1584-4e35-890e-52c931d358dc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:46.995792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b13b1-1584-4e35-890e-52c931d358dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.069304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7e6b13b1-1584-4e35-890e-52c931d358dc None None] MFA Rules not processed for user `1d6c68a0197548ab91bd66342974dd28`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:47.070563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7e6b13b1-1584-4e35-890e-52c931d358dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:47.138416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:47.139346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:47.139596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:47.142063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.142744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:47.145662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:47.203301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 890/1769] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:46 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:47.205195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:47.236343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969e42a-20a8-4702-8550-a796348c0b58 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:47.259889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:47.272649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 880/1770] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:47.274901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:47.275389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:47.275472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.278990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b13b1-1584-4e35-890e-52c931d358dc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:47.282364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:47.292129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:47.298251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:47.331356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b13b1-1584-4e35-890e-52c931d358dc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:47.351056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 891/1771] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:47.354746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:47.355392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:47.355682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:47.355958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.356626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:47.362031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:47.367171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:47.389948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb2a51-6d76-4c96-ae19-2dd998c67bb8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:47.410680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 881/1772] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:47.410882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:47.414166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:47.416152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:47.419785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:47.420128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.420863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:47.422845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:47.426964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:47.469883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 892/1773] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:47.470664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:47.499997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2f18-954d-41e5-baac-c9d467f563f7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:47.513856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:47.514468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:47.514750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:47.515020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] PATH_INFO: `/v3/projects/67c9c3c2a6db409aacece8842c3c313b/users/09b0927cdc8e4ca9973ffc41b74905cb/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.559924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c9c3c2a6db409aacece8842c3c313b, user_id=09b0927cdc8e4ca9973ffc41b74905cb, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:47.563665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:47.575464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:47.603274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 893/1774] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:47 2022] PUT /identity/v3/projects/67c9c3c2a6db409aacece8842c3c313b/users/09b0927cdc8e4ca9973ffc41b74905cb/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:47.606425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:47.645418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a81ef-95ef-4159-adb9-04c83cd0613a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:47.814863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa3f42-bfbd-4924-a503-1b36da51db3f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:47.834357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:47.835028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:47.835422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:47.835578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] PATH_INFO: `/v3/projects/1d294061a16140bca2334ea75ae716e9/users/d41f5e8e036e49e5bc9773b1559078c7/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.845574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d294061a16140bca2334ea75ae716e9, user_id=d41f5e8e036e49e5bc9773b1559078c7, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:47.850793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:47.875866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:47.875866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:47.875866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:47.875866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:47.900922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 894/1775] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:47 2022] PUT /identity/v3/projects/1d294061a16140bca2334ea75ae716e9/users/d41f5e8e036e49e5bc9773b1559078c7/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:47.902233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:48.078798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:48.085299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:48.123559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513197f-36a0-4d0c-9000-989649133fc1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:48.138587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 882/1776] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:48.147214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:48.158603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c832521-079a-4535-96d7-a1bf0ebad7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:48.165191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832521-079a-4535-96d7-a1bf0ebad7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:48.167528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832521-079a-4535-96d7-a1bf0ebad7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:48.170919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c832521-079a-4535-96d7-a1bf0ebad7f0 admin admin] PATH_INFO: `/v3/projects/2df4320ac48f4498854329ba29c02cb0/users/1485c3cbc1e44a2892b200fa0fb17387/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:48.203492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71d732-d197-44a8-82e8-4ffb2d6ba052 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:48.219731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:48.220418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:48.220743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:48.221047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:48.221757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:48.224062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:48.236999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c832521-079a-4535-96d7-a1bf0ebad7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df4320ac48f4498854329ba29c02cb0, user_id=1485c3cbc1e44a2892b200fa0fb17387, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:48.240433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c832521-079a-4535-96d7-a1bf0ebad7f0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:48.268012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 883/1777] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:48.269666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:48.277639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:48.291848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 895/1778] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:47 2022] PUT /identity/v3/projects/2df4320ac48f4498854329ba29c02cb0/users/1485c3cbc1e44a2892b200fa0fb17387/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:48.298092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7517e-f176-48dd-952b-8f63229125f6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:48.299283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7517e-f176-48dd-952b-8f63229125f6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:48.301118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7517e-f176-48dd-952b-8f63229125f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:48.326891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de7cc8-ceb2-4296-9081-b8025627ba59 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:48.386124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-63a7517e-f176-48dd-952b-8f63229125f6 None None] MFA Rules not processed for user `d41f5e8e036e49e5bc9773b1559078c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:48.387581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-63a7517e-f176-48dd-952b-8f63229125f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:48.470311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:48.521304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:48.522055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:48.522368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:48.522652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] PATH_INFO: `/v3/projects/1acd81313a324d9d9ba8616341713aa9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:48.526314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1acd81313a324d9d9ba8616341713aa9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:48.529902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:48.577318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 896/1779] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:48.580527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7517e-f176-48dd-952b-8f63229125f6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:48.600697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:48.622100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7517e-f176-48dd-952b-8f63229125f6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:48.641359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:48.643331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:48.646254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:48.646675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] PATH_INFO: `/v3/projects/67c9c3c2a6db409aacece8842c3c313b/users/09b0927cdc8e4ca9973ffc41b74905cb/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:48.654348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c9c3c2a6db409aacece8842c3c313b, user_id=09b0927cdc8e4ca9973ffc41b74905cb, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:48.658412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:48.712600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1acd81313a324d9d9ba8616341713aa9', 'request_id': 'req-389141d1-52bb-45dc-9e05-4cc59df04780'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:48.715030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 897/1780] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:48 2022] PUT /identity/v3/projects/67c9c3c2a6db409aacece8842c3c313b/users/09b0927cdc8e4ca9973ffc41b74905cb/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:48.717738 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:48.754518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1acd81313a324d9d9ba8616341713aa9', 'request_id': 'req-389141d1-52bb-45dc-9e05-4cc59df04780'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:48.769750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1acd81313a324d9d9ba8616341713aa9', 'request_id': 'req-389141d1-52bb-45dc-9e05-4cc59df04780'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:48.797147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] The token cache is being invalidate because project 1acd81313a324d9d9ba8616341713aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:48.797495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:48.798213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:48.807327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 884/1781] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:48 2022] DELETE /identity/v3/projects/1acd81313a324d9d9ba8616341713aa9 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:48.808476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:48.818266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:49.004429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b928679-a11e-4dc9-a695-47c268f63e97 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:49.009884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389141d1-52bb-45dc-9e05-4cc59df04780 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:49.036682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7703b-6672-462d-8bc2-99dc403ef9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:49.037428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7703b-6672-462d-8bc2-99dc403ef9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:49.037739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7703b-6672-462d-8bc2-99dc403ef9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:49.038401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7703b-6672-462d-8bc2-99dc403ef9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:49.039726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7703b-6672-462d-8bc2-99dc403ef9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:49.046178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7703b-6672-462d-8bc2-99dc403ef9a5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:49.080709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 898/1782] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:49.081601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:49.081601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:49.088282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:49.159526 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] MFA Rules not processed for user `09b0927cdc8e4ca9973ffc41b74905cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:49.164769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:49.202695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aedae9-7576-4a6a-9a67-2f4ae352509d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:49.202695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedae9-7576-4a6a-9a67-2f4ae352509d service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:49.203038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedae9-7576-4a6a-9a67-2f4ae352509d service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:49.203132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aedae9-7576-4a6a-9a67-2f4ae352509d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:49.210151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f6aedae9-7576-4a6a-9a67-2f4ae352509d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:49.448658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 899/1783] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:49.449270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedae9-7576-4a6a-9a67-2f4ae352509d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:49.449380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:49.449483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aedae9-7576-4a6a-9a67-2f4ae352509d service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:49.463135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 885/1784] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:49.463732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:49.464638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:49.464935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:49.465216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:49.489983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6446ac7-bda0-4307-811b-3b207ecc7426 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:49.496325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:49.497057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:49.497573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:49.497801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] PATH_INFO: `/v3/users/154ac2468ae84092b81672164fa55656` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:49.499379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=154ac2468ae84092b81672164fa55656)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:49.502639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:49.504686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:49.521299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] MFA Rules not processed for user `97d63b77d6914ab58f4b745d0a0e5470`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:49.522964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:49.569156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:49.626369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154ac2468ae84092b81672164fa55656'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:49.631086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154ac2468ae84092b81672164fa55656'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:49.653081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154ac2468ae84092b81672164fa55656'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:49.655632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154ac2468ae84092b81672164fa55656'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:49.677346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154ac2468ae84092b81672164fa55656'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:49.696615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 886/1785] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:49.699077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:49.705250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:49.745146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5912ef-d32d-4584-94cc-403c0fa64f58 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:49.746378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 900/1786] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:49 2022] DELETE /identity/v3/users/154ac2468ae84092b81672164fa55656 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:49.748434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:49.754993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:49.892137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5d362-17dd-4444-a250-468e7327a849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:49.893160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d362-17dd-4444-a250-468e7327a849 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:49.894949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d362-17dd-4444-a250-468e7327a849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:49.895509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5d362-17dd-4444-a250-468e7327a849 admin admin] PATH_INFO: `/v3/projects/2df4320ac48f4498854329ba29c02cb0/users/1485c3cbc1e44a2892b200fa0fb17387/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:49.901575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5d362-17dd-4444-a250-468e7327a849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df4320ac48f4498854329ba29c02cb0, user_id=1485c3cbc1e44a2892b200fa0fb17387, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:49.911105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5d362-17dd-4444-a250-468e7327a849 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:49.952327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277eb10-7ae2-402a-82f0-d29a3c17aebd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:49.967867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 887/1787] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:49 2022] PUT /identity/v3/projects/2df4320ac48f4498854329ba29c02cb0/users/1485c3cbc1e44a2892b200fa0fb17387/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:49.967867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2806-cf64-4b55-a844-29fd01b7ac41 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:49.967867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2806-cf64-4b55-a844-29fd01b7ac41 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:49.967867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d2806-cf64-4b55-a844-29fd01b7ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:50.026308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c58d2806-cf64-4b55-a844-29fd01b7ac41 None None] MFA Rules not processed for user `97d63b77d6914ab58f4b745d0a0e5470`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:50.029736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c58d2806-cf64-4b55-a844-29fd01b7ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:50.126368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:50.128164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:50.128601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:50.128909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:50.140995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:50.221517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 888/1788] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:50.222866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c3e6-d7b9-41bf-82b5-c845355bb3a7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:50.223378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c3e6-d7b9-41bf-82b5-c845355bb3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:50.224250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c3e6-d7b9-41bf-82b5-c845355bb3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:50.302884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d608c3e6-d7b9-41bf-82b5-c845355bb3a7 None None] MFA Rules not processed for user `1485c3cbc1e44a2892b200fa0fb17387`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:50.305499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d608c3e6-d7b9-41bf-82b5-c845355bb3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:50.386434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:50.402269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:50.412370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:50.427735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 901/1789] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:50.428654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:50.430244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:50.446720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:50.581619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 889/1790] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:50.593851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608c3e6-d7b9-41bf-82b5-c845355bb3a7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:50.627866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608c3e6-d7b9-41bf-82b5-c845355bb3a7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:50.632342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbac3a-fdfd-4062-9ba9-203a96cd49c5 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:50.639988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:50.643499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:50.644739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:50.645067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:50.654262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91115ccd-6853-4872-9ee5-fce2f99f0a91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:50.654910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115ccd-6853-4872-9ee5-fce2f99f0a91 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:50.661752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115ccd-6853-4872-9ee5-fce2f99f0a91 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:50.664317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91115ccd-6853-4872-9ee5-fce2f99f0a91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:50.668757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-91115ccd-6853-4872-9ee5-fce2f99f0a91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:50.695737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:50.702981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115ccd-6853-4872-9ee5-fce2f99f0a91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:50.703400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:50.705609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91115ccd-6853-4872-9ee5-fce2f99f0a91 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:50.750709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 890/1791] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:50.760928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 902/1792] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:51.093239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:51.109642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a0074-478e-4683-95b5-4a9c04da44e7 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:51.129538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3848cc-ebb9-4faf-9b41-871a179a2591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:51.130221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3848cc-ebb9-4faf-9b41-871a179a2591 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:51.130515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3848cc-ebb9-4faf-9b41-871a179a2591 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:51.130798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3848cc-ebb9-4faf-9b41-871a179a2591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:51.149939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ad3848cc-ebb9-4faf-9b41-871a179a2591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:51.319512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3848cc-ebb9-4faf-9b41-871a179a2591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:51.321952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3848cc-ebb9-4faf-9b41-871a179a2591 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:51.348653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 891/1793] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:51.896838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4166a-9122-48c8-8db1-efc358a4cac8 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:51.897491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4166a-9122-48c8-8db1-efc358a4cac8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:51.897592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4166a-9122-48c8-8db1-efc358a4cac8 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:51.899534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 903/1794] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:55:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:51.987123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f4648-8ef6-450a-9126-c746034a3146 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:51.987454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f4648-8ef6-450a-9126-c746034a3146 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:51.987852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f4648-8ef6-450a-9126-c746034a3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:52.040086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d99f4648-8ef6-450a-9126-c746034a3146 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:52.047704 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d99f4648-8ef6-450a-9126-c746034a3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:52.079218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 892/1795] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:55:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:52.327470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4166a-9122-48c8-8db1-efc358a4cac8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:52.329761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-26a4166a-9122-48c8-8db1-efc358a4cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:52.418091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4166a-9122-48c8-8db1-efc358a4cac8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:52.433483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f69a0-993c-44bb-a439-cf4a783cb3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:52.435643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f69a0-993c-44bb-a439-cf4a783cb3bc service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:52.438562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f69a0-993c-44bb-a439-cf4a783cb3bc service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:52.438562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f69a0-993c-44bb-a439-cf4a783cb3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:52.473012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f69a0-993c-44bb-a439-cf4a783cb3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:52.475322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f69a0-993c-44bb-a439-cf4a783cb3bc service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:52.555321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 904/1796] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:53.025865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608cb9f-babc-43ba-a4f7-b999caa5e9ff None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:53.027821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608cb9f-babc-43ba-a4f7-b999caa5e9ff None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:53.028424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608cb9f-babc-43ba-a4f7-b999caa5e9ff None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:53.030278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 893/1797] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:55:53.163218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:53.163828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:53.164218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:53.253115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:53.254950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:53.311565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 905/1798] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:55:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:53.372120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608cb9f-babc-43ba-a4f7-b999caa5e9ff None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:53.374221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3608cb9f-babc-43ba-a4f7-b999caa5e9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:53.414132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608cb9f-babc-43ba-a4f7-b999caa5e9ff None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:53.435059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242911e-30ee-4c5e-95bd-316db509d83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:53.436682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242911e-30ee-4c5e-95bd-316db509d83a service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:53.437230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242911e-30ee-4c5e-95bd-316db509d83a service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:53.437768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242911e-30ee-4c5e-95bd-316db509d83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:53.440195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c242911e-30ee-4c5e-95bd-316db509d83a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:53.601344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242911e-30ee-4c5e-95bd-316db509d83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:53.603188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242911e-30ee-4c5e-95bd-316db509d83a service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:53.626456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 894/1799] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:55.117640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:55.118976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:55.259505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a908-41df-4723-b986-57c3c1bfdfeb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:55.260077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a908-41df-4723-b986-57c3c1bfdfeb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:55.260295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2a908-41df-4723-b986-57c3c1bfdfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:55.305140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bca38-8963-4281-a42b-4c5cbb7b527c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:55.323980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:55.326061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:55.326061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:55.326061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] PATH_INFO: `/v3/projects/570613cb3ea14c54a76ef62c9a98721e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:55.326466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=570613cb3ea14c54a76ef62c9a98721e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:55.329445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:55.349098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4bb2a908-41df-4723-b986-57c3c1bfdfeb None None] MFA Rules not processed for user `a42d659ce7bb4946bd082a07d9339e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:55.355346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4bb2a908-41df-4723-b986-57c3c1bfdfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:55.434964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:55.456469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570613cb3ea14c54a76ef62c9a98721e', 'request_id': 'req-db908230-86d9-4128-91a2-82b7fad10c0a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.465983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 895/1800] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:55:55.466859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a908-41df-4723-b986-57c3c1bfdfeb None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:55.478559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570613cb3ea14c54a76ef62c9a98721e', 'request_id': 'req-db908230-86d9-4128-91a2-82b7fad10c0a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.492708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570613cb3ea14c54a76ef62c9a98721e', 'request_id': 'req-db908230-86d9-4128-91a2-82b7fad10c0a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.506125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2a908-41df-4723-b986-57c3c1bfdfeb None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:55.525171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] The token cache is being invalidate because project 570613cb3ea14c54a76ef62c9a98721e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:55.528493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.531351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.539095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 906/1801] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:55 2022] DELETE /identity/v3/projects/570613cb3ea14c54a76ef62c9a98721e => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:55.541966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:55.545845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:55.565233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:55.626851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:55.629322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:55.629754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:55.630106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:55.632297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:55.651989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:55.658273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:55.683805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db908230-86d9-4128-91a2-82b7fad10c0a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:55.693740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:55.694443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:55.694560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 896/1802] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:55.694727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:55.695123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] PATH_INFO: `/v3/users/4966579b3b3445ef93be8cb126671be7` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:55.697197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4966579b3b3445ef93be8cb126671be7)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:55.697327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:55.699690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:55.700701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:55.797847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb5a40-437f-4cc9-918c-fe8a6d92e4d5 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:55.817441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:55.818169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:55.818408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:55.818689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] PATH_INFO: `/v3/users/81999237dc704cdaa8ad5bf9d0212db1` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:55.820426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81999237dc704cdaa8ad5bf9d0212db1)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:55.822371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:55.839853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4966579b3b3445ef93be8cb126671be7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.843273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4966579b3b3445ef93be8cb126671be7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.863384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4966579b3b3445ef93be8cb126671be7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.865553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4966579b3b3445ef93be8cb126671be7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.884585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5dc33b63-e993-4619-a9c4-38b0259ad4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4966579b3b3445ef93be8cb126671be7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:55.960739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 907/1803] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:55 2022] DELETE /identity/v3/users/4966579b3b3445ef93be8cb126671be7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:55.960739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125b8e-bc77-45ed-8daa-89c99b70b135 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:55.960739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125b8e-bc77-45ed-8daa-89c99b70b135 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:55.960739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125b8e-bc77-45ed-8daa-89c99b70b135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.019221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81999237dc704cdaa8ad5bf9d0212db1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:56.021740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81999237dc704cdaa8ad5bf9d0212db1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:56.023131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81999237dc704cdaa8ad5bf9d0212db1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:56.063383 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81999237dc704cdaa8ad5bf9d0212db1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:56.093550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-05357111-d46e-488a-bdb2-6a1a0e9ea954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81999237dc704cdaa8ad5bf9d0212db1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:56.108775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f1125b8e-bc77-45ed-8daa-89c99b70b135 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:56.110082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f1125b8e-bc77-45ed-8daa-89c99b70b135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:56.181466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 897/1804] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:55 2022] DELETE /identity/v3/users/81999237dc704cdaa8ad5bf9d0212db1 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:56.186902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f600-6d36-462e-9f5a-d16bc5b63057 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:56.201406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f600-6d36-462e-9f5a-d16bc5b63057 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:56.201874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f600-6d36-462e-9f5a-d16bc5b63057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.275447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d488f600-6d36-462e-9f5a-d16bc5b63057 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:56.276799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d488f600-6d36-462e-9f5a-d16bc5b63057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:56.327262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 908/1805] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:56.328221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:56.328554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:56.328834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.376720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:56.378419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:56.399391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:56.445963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:56.492469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 898/1806] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:56.496571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6b69-5205-4a7a-92f7-190a8bac77cc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:56.497060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6b69-5205-4a7a-92f7-190a8bac77cc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:56.497366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e6b69-5205-4a7a-92f7-190a8bac77cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.532497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f12e6b69-5205-4a7a-92f7-190a8bac77cc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:56.533927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f12e6b69-5205-4a7a-92f7-190a8bac77cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:56.558755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 899/1807] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:56.563533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6b69-5205-4a7a-92f7-190a8bac77cc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:56.578448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 909/1808] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:56.610724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:56.612741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e6b69-5205-4a7a-92f7-190a8bac77cc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:56.617825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:56.622916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:56.623948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:56.624846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:56.625333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.626810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:55:56.627531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:56.630108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:56.653752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 900/1809] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:55:56.654739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:56.657949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:56.758627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5496-c05e-4856-84fa-75839ec9bcf9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:56.767410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:56.769287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:56.770012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:56.771898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.792678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa9760-bd9b-48d9-8ed3-a22a559ac3f8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:56.802791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:56.803432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:56.803715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:56.803993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.809770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:56.811541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:56.830343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:56.838439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 901/1810] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:56.839335 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:56.839454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:56.860147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a444b-17a0-41b6-a5db-6e1a8ff766c5 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:56.868781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 910/1811] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:55:56.875409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:56.876120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:56.876530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:56.876880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:56.877596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:56.880140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:56.923397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 902/1812] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:56 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:56.927643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:56.952460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465a06f-065b-4e3d-9fab-b7cf001de679 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:57.037283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:57.037935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:57.038330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:57.039011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:57.039748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:57.042241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:57.072897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 911/1813] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:56 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:57.077468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:57.094336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e12fe-9172-46ad-84e7-db3262852b9d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:57.100807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:57.101569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:57.101977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:57.102344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:57.103075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:57.105108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:57.124551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 903/1814] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:57.129336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:57.155975 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc8b37-45f6-47b3-8643-77132dd603f8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:57.165691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7e2b-0552-4ab6-a35a-597178d940c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:57.166667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7e2b-0552-4ab6-a35a-597178d940c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:57.167027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7e2b-0552-4ab6-a35a-597178d940c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:57.167834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7e2b-0552-4ab6-a35a-597178d940c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:57.168651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7e2b-0552-4ab6-a35a-597178d940c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:57.170528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7e2b-0552-4ab6-a35a-597178d940c2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:57.198622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 912/1815] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:57.202782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:57.220971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bccc-f315-4c59-bef1-186246c76127 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:57.235202 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:57.236606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:57.237057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:57.238412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] PATH_INFO: `/v3/projects/e80239301bec485fada3976efa875d02/users/54f1e2f4aa8c4646a1c3070b38fb9506/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:57.292757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80239301bec485fada3976efa875d02, user_id=54f1e2f4aa8c4646a1c3070b38fb9506, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:57.296930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:57.336468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 904/1816] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:57 2022] PUT /identity/v3/projects/e80239301bec485fada3976efa875d02/users/54f1e2f4aa8c4646a1c3070b38fb9506/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:57.341041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21082350-a3a8-4d77-a2aa-2db099f1b6da None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:57.341568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21082350-a3a8-4d77-a2aa-2db099f1b6da None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:57.341661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21082350-a3a8-4d77-a2aa-2db099f1b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:57.496779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-21082350-a3a8-4d77-a2aa-2db099f1b6da None None] MFA Rules not processed for user `54f1e2f4aa8c4646a1c3070b38fb9506`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:57.501106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-21082350-a3a8-4d77-a2aa-2db099f1b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:57.597244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:57.672206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:57.682671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 913/1817] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:57.845943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f5a1f-743a-410c-9822-070c95b23453 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:57.855628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:57.856375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:57.857203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:57.857562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:57.859302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:57.882038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:57.934194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:57.969287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9aab9-f0a2-4ccf-b56f-1f98456bc45a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:57.969287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9aab9-f0a2-4ccf-b56f-1f98456bc45a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:57.969667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9aab9-f0a2-4ccf-b56f-1f98456bc45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:58.013444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 905/1818] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:57 2022] POST /identity/v3/projects => generated 387 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:58.014407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.041246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-78b9aab9-f0a2-4ccf-b56f-1f98456bc45a None None] MFA Rules not processed for user `1d6c68a0197548ab91bd66342974dd28`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:58.047570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78b9aab9-f0a2-4ccf-b56f-1f98456bc45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:58.129763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151b8f2-7f2c-4a3b-befb-e2ce5f40150c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:58.138363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:58.139010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:58.139376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:58.139649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:58.140294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:58.142525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:58.182215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 906/1819] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:58 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:55:58.183538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.185781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:58.203343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcd1de-55e2-420c-a1ef-2b4d02cb48ff admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:58.210702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:58.212040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:58.212422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:58.212782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] PATH_INFO: `/v3/projects/612322e852f04e3c9abca86a1ede97ff` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:58.214674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=612322e852f04e3c9abca86a1ede97ff)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:58.217332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:58.225521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 914/1820] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:55:58.227464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9aab9-f0a2-4ccf-b56f-1f98456bc45a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.244376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9aab9-f0a2-4ccf-b56f-1f98456bc45a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:58.251031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:58.252243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:58.252922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:58.253636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:58.254887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:58.257252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:58.284207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 915/1821] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:58.284973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612322e852f04e3c9abca86a1ede97ff', 'request_id': 'req-c001cbe0-61f6-4653-88d1-4e8831e367ea'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.292788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.294386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612322e852f04e3c9abca86a1ede97ff', 'request_id': 'req-c001cbe0-61f6-4653-88d1-4e8831e367ea'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.307331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612322e852f04e3c9abca86a1ede97ff', 'request_id': 'req-c001cbe0-61f6-4653-88d1-4e8831e367ea'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.320184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78eca-e5c9-457a-8dcf-b9bb6d8bfb50 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:58.324930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] The token cache is being invalidate because project 612322e852f04e3c9abca86a1ede97ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:58.325419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.326419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.328871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 907/1822] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:58 2022] DELETE /identity/v3/projects/612322e852f04e3c9abca86a1ede97ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:58.333076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.336208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:58.466028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:58.466671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:58.466956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:58.467601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:58.467903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:58.469598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:58.494897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001cbe0-61f6-4653-88d1-4e8831e367ea admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:58.496670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 916/1823] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:55:58.500848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.502903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:58.504940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:58.505668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:58.506268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] PATH_INFO: `/v3/users/09b0927cdc8e4ca9973ffc41b74905cb` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:58.508177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b0927cdc8e4ca9973ffc41b74905cb)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:58.510057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:58.511901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:58.519567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:58.540465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0ec5-efbf-42fc-8b99-ff7dd216936c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:58.553459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:58.554320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:58.554905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:58.555289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] PATH_INFO: `/v3/projects/fafd2f8e1dd3403a894e901b3a5f5a27` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:58.558570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafd2f8e1dd3403a894e901b3a5f5a27)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:58.565586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:58.703693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b0927cdc8e4ca9973ffc41b74905cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.704782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b0927cdc8e4ca9973ffc41b74905cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.706351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b0927cdc8e4ca9973ffc41b74905cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.745665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b0927cdc8e4ca9973ffc41b74905cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.787934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b0927cdc8e4ca9973ffc41b74905cb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.821903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafd2f8e1dd3403a894e901b3a5f5a27', 'request_id': 'req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.849166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafd2f8e1dd3403a894e901b3a5f5a27', 'request_id': 'req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.864630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:58.869299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 908/1824] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:58 2022] DELETE /identity/v3/users/09b0927cdc8e4ca9973ffc41b74905cb => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:58.873051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.876033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:58.877492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafd2f8e1dd3403a894e901b3a5f5a27', 'request_id': 'req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.904676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] The token cache is being invalidate because project fafd2f8e1dd3403a894e901b3a5f5a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:55:58.905027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.906491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:58.913954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 917/1825] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:55:58 2022] DELETE /identity/v3/projects/fafd2f8e1dd3403a894e901b3a5f5a27 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:58.914845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:58.916277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:59.033770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702f5cc-c157-4716-9552-8542329ceef4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:59.055539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365aacc-fa4d-4389-ad51-3a1853034be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:59.061476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365aacc-fa4d-4389-ad51-3a1853034be7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:59.061604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a30f52-e1ff-4adb-bbde-9e3b05edc893 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:59.062118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365aacc-fa4d-4389-ad51-3a1853034be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:59.062929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365aacc-fa4d-4389-ad51-3a1853034be7 admin admin] PATH_INFO: `/v3/projects/c867ab172c60477e9a52283e8fd96d3f/users/ca8d474ecdeb4bf5a79c7b2cb0ff8b9d/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:59.090350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:59.091021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:59.092239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:59.106040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] PATH_INFO: `/v3/users/1485c3cbc1e44a2892b200fa0fb17387` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:59.109557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1485c3cbc1e44a2892b200fa0fb17387)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:59.117536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:59.133450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365aacc-fa4d-4389-ad51-3a1853034be7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c867ab172c60477e9a52283e8fd96d3f, user_id=ca8d474ecdeb4bf5a79c7b2cb0ff8b9d, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:59.138902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365aacc-fa4d-4389-ad51-3a1853034be7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:59.178710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 909/1826] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:55:58 2022] PUT /identity/v3/projects/c867ab172c60477e9a52283e8fd96d3f/users/ca8d474ecdeb4bf5a79c7b2cb0ff8b9d/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:59.193661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353948-2eec-4c1a-b375-cb40d75b9e1c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:59.194082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353948-2eec-4c1a-b375-cb40d75b9e1c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:59.194370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e353948-2eec-4c1a-b375-cb40d75b9e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:59.297681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1485c3cbc1e44a2892b200fa0fb17387'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:59.298560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1485c3cbc1e44a2892b200fa0fb17387'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:59.319352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1e353948-2eec-4c1a-b375-cb40d75b9e1c None None] MFA Rules not processed for user `ca8d474ecdeb4bf5a79c7b2cb0ff8b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:55:59.321067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1e353948-2eec-4c1a-b375-cb40d75b9e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:59.321909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1485c3cbc1e44a2892b200fa0fb17387'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:59.324205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1485c3cbc1e44a2892b200fa0fb17387'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:59.355977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1485c3cbc1e44a2892b200fa0fb17387'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:55:59.422983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 918/1827] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:55:58 2022] DELETE /identity/v3/users/1485c3cbc1e44a2892b200fa0fb17387 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:55:59.493355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:59.525999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 910/1828] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:55:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:55:59.527000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:59.529316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:55:59.699768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e0ea1-bfbd-496d-a4eb-a62db88b1685 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:59.705043 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:59.706762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:59.707055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:59.707407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:59.708190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:59.710381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:55:59.743913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:55:59.777463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 919/1829] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:55:59 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:55:59.783998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e353948-2eec-4c1a-b375-cb40d75b9e1c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:55:59.893968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e353948-2eec-4c1a-b375-cb40d75b9e1c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:55:59.984771 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:55:59.985635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:55:59.986480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:55:59.986480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:55:59.987557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:55:59.990064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:00.036182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 911/1830] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:55:59 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:00.038254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:00.060550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41f294-5ce3-430f-8fde-307208b605d7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:00.075407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:00.076084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.076410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.076736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.098707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:00.100939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:00.122266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:00.124463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:00.135279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 920/1831] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:00.138994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:00.151081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf8b1-e46e-4af4-8e1b-c65cfb2eaf38 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:00.163596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cbcca-02a9-4019-a5c1-4dc8ec89a957 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:00.168599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:00.169438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.169634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:00.170002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.170383 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] PATH_INFO: `/v3/projects/2df4320ac48f4498854329ba29c02cb0` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.170841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.171284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.171710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] PATH_INFO: `/v3/projects/f9643715fcbf432eaba0eecaabb408d6/users/f705310437924fe3a7fea37f34fface9/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.172203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df4320ac48f4498854329ba29c02cb0)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:00.175199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:00.191122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9643715fcbf432eaba0eecaabb408d6, user_id=f705310437924fe3a7fea37f34fface9, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:00.194781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:00.213868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 921/1832] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:00 2022] PUT /identity/v3/projects/f9643715fcbf432eaba0eecaabb408d6/users/f705310437924fe3a7fea37f34fface9/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:00.218629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:00.259218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df4320ac48f4498854329ba29c02cb0', 'request_id': 'req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.269184 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df4320ac48f4498854329ba29c02cb0', 'request_id': 'req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.283231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df4320ac48f4498854329ba29c02cb0', 'request_id': 'req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.300838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] The token cache is being invalidate because project 2df4320ac48f4498854329ba29c02cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:00.301137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.302528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-4f1efd5f-57b9-4b5c-8750-7038bc1abe85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.307920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 912/1833] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:00 2022] DELETE /identity/v3/projects/2df4320ac48f4498854329ba29c02cb0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:00.311197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.311967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.312622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.321291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbaeeb-1154-4251-876b-8b6e2df91b23 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:00.341931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:00.344510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:00.364653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:00.512878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:00.513815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.514248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.514667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.515680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:00.518414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:00.550933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 922/1834] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:00.552440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:00.554543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:00.585983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1c3f0-9017-490c-9f90-f5b4f8f34515 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:00.589842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 913/1835] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:00.590758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:00.599728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:00.603434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b842b-c1ae-4ede-8069-d7ee77ad0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:00.606557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b842b-c1ae-4ede-8069-d7ee77ad0ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.617874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b842b-c1ae-4ede-8069-d7ee77ad0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.618274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b842b-c1ae-4ede-8069-d7ee77ad0ff7 admin admin] PATH_INFO: `/v3/projects/f9643715fcbf432eaba0eecaabb408d6/users/f705310437924fe3a7fea37f34fface9/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.622699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b842b-c1ae-4ede-8069-d7ee77ad0ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9643715fcbf432eaba0eecaabb408d6, user_id=f705310437924fe3a7fea37f34fface9, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:00.624489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f6056-fdc9-46e1-814d-7dbb3b05c9b6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:00.626054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b842b-c1ae-4ede-8069-d7ee77ad0ff7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:00.636037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:00.640315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.640315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.640315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] PATH_INFO: `/v3/projects/67c9c3c2a6db409aacece8842c3c313b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.640315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c9c3c2a6db409aacece8842c3c313b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:00.642524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:00.666683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 923/1836] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:00 2022] PUT /identity/v3/projects/f9643715fcbf432eaba0eecaabb408d6/users/f705310437924fe3a7fea37f34fface9/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:00.668234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb8ac-4714-42e2-9517-71f38b9adb19 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.668550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb8ac-4714-42e2-9517-71f38b9adb19 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.669009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb8ac-4714-42e2-9517-71f38b9adb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.735611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c81cb8ac-4714-42e2-9517-71f38b9adb19 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:00.739104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c81cb8ac-4714-42e2-9517-71f38b9adb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:00.767377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c9c3c2a6db409aacece8842c3c313b', 'request_id': 'req-b18aaa3a-cb92-4c5a-9a48-50c127007de9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.783927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c9c3c2a6db409aacece8842c3c313b', 'request_id': 'req-b18aaa3a-cb92-4c5a-9a48-50c127007de9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.802961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c9c3c2a6db409aacece8842c3c313b', 'request_id': 'req-b18aaa3a-cb92-4c5a-9a48-50c127007de9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.846572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] The token cache is being invalidate because project 67c9c3c2a6db409aacece8842c3c313b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:00.846834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.855290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b18aaa3a-cb92-4c5a-9a48-50c127007de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:00.860637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 914/1837] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:00 2022] DELETE /identity/v3/projects/67c9c3c2a6db409aacece8842c3c313b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:00.862012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d936d4-099b-4829-9814-d465ca7ee5ca None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.862354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d936d4-099b-4829-9814-d465ca7ee5ca None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.862639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d936d4-099b-4829-9814-d465ca7ee5ca None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.876839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 915/1838] 10.222.0.42 () {54 vars in 912 bytes} [Wed Aug 24 08:56:00 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:56:00.880257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eb93b-99d6-4367-8d08-6b588a1ed16d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.882483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eb93b-99d6-4367-8d08-6b588a1ed16d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.882993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eb93b-99d6-4367-8d08-6b588a1ed16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.887271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:00.935651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 924/1839] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:00.939956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21c4b8-5aba-4b95-9363-e7ae41ab24af None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:00.941129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21c4b8-5aba-4b95-9363-e7ae41ab24af None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:00.942037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21c4b8-5aba-4b95-9363-e7ae41ab24af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:00.973397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e43eb93b-99d6-4367-8d08-6b588a1ed16d None None] MFA Rules not processed for user `f705310437924fe3a7fea37f34fface9`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:00.975869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e43eb93b-99d6-4367-8d08-6b588a1ed16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:01.000889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0f21c4b8-5aba-4b95-9363-e7ae41ab24af None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:01.021027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0f21c4b8-5aba-4b95-9363-e7ae41ab24af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:01.039535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 925/1840] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:01.041911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.043375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.044233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.081293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] MFA Rules not processed for user `7194e3fe0d2d46ada270bb440cd79911`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:01.086279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:01.132350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 916/1841] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:01.133745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eb93b-99d6-4367-8d08-6b588a1ed16d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.149355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eb93b-99d6-4367-8d08-6b588a1ed16d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.155737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ced4b-608c-4bed-bbf5-a79b9ae2412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.156374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ced4b-608c-4bed-bbf5-a79b9ae2412b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.156693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ced4b-608c-4bed-bbf5-a79b9ae2412b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.156976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ced4b-608c-4bed-bbf5-a79b9ae2412b admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.158212 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ced4b-608c-4bed-bbf5-a79b9ae2412b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:01.158527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ced4b-608c-4bed-bbf5-a79b9ae2412b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.161107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ced4b-608c-4bed-bbf5-a79b9ae2412b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.181780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 917/1842] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:01.183438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94a5d-96d0-4135-a50e-db48d2a87288 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.184171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94a5d-96d0-4135-a50e-db48d2a87288 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.184253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94a5d-96d0-4135-a50e-db48d2a87288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.203322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 926/1843] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:01.204483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.206908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:01.218753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-dca94a5d-96d0-4135-a50e-db48d2a87288 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:01.220177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dca94a5d-96d0-4135-a50e-db48d2a87288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:01.242060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 918/1844] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:01.242060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94a5d-96d0-4135-a50e-db48d2a87288 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.248979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:01.256425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94a5d-96d0-4135-a50e-db48d2a87288 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.266450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.268434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.269927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.270441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.271970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.275231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.306286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37fb3a-64f4-4cdc-8da9-53f044e460d8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.312923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.313594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.313886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.314197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.329216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.329880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 919/1845] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:01 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:01.331974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.334439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.350945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 927/1846] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:01.352757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.354413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:01.371692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150eb91-ae32-4145-807d-b0a72750d46f service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.441643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1565037-c33e-480a-8ad0-a739490ab678 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.454438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.456669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.457654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.458304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.459538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:01.460254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.463051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.463200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.463732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.464017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.464632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.475761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.478089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.493204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 928/1847] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:01.495316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.500452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 920/1848] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:01.511709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.515316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74fd46-4f8c-43e5-92a9-aa9af2b5fc7a service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.523937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.525393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.526102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.526821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.528784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.532166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.539435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57511fc-942e-4d9e-a55b-bcf7b558f417 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.553291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.554151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.554496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.554920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.555681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.557934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.563229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 929/1849] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:01 2022] POST /identity/v3/users => generated 288 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:01.567785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.603001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8a936-7bc9-4af9-a77a-72ff9f5d4492 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.613389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.637206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.637888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.640230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.641809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.641931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 921/1850] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:01 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:01.643567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.647438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.688114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 930/1851] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:01.703195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.755100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e344ca-ccc7-428e-8289-64a0471cdc44 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.762453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.764608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.765003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.765620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.766446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.768168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538cc3-4618-4b1c-a97d-504704b71542 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.771069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.795491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.796783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.796783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.797248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.798000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.800320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.811563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:01.837144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 922/1852] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:01 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:01.841072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.851516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 931/1853] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:01.856127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.870855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef08d1-d39c-473d-9c76-57496e1bbfed admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.874471 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1bc9e-88e7-45a6-97fa-6aa30f57b965 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:01.879488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83633fdc-46a6-46d2-9535-bab1583511d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.880623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633fdc-46a6-46d2-9535-bab1583511d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.881207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633fdc-46a6-46d2-9535-bab1583511d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.881743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83633fdc-46a6-46d2-9535-bab1583511d7 admin admin] PATH_INFO: `/v3/projects/15a80c4478f74e638c59385bd2692f13/users/b8fc393260564ae487d0384dbdf39eb6/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.884250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:01.886114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.886512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.888470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.889585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.897880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.911032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83633fdc-46a6-46d2-9535-bab1583511d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a80c4478f74e638c59385bd2692f13, user_id=b8fc393260564ae487d0384dbdf39eb6, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:01.915301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83633fdc-46a6-46d2-9535-bab1583511d7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:01.918844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 923/1854] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:01.924130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:01.944247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 932/1855] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:01 2022] PUT /identity/v3/projects/15a80c4478f74e638c59385bd2692f13/users/b8fc393260564ae487d0384dbdf39eb6/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:01.959541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea1eb-64eb-46e1-ade5-f19052287259 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:01.960114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea1eb-64eb-46e1-ade5-f19052287259 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:01.960781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea1eb-64eb-46e1-ade5-f19052287259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:01.961017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc5a91-7223-471d-baaf-bd5a2c64d157 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:02.017894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:02.053974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-867ea1eb-64eb-46e1-ade5-f19052287259 None None] MFA Rules not processed for user `b8fc393260564ae487d0384dbdf39eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:02.055845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-867ea1eb-64eb-46e1-ade5-f19052287259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:02.078706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:02.079590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:02.082133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:02.082612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:02.083446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:02.087416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:02.106905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 924/1856] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:02.108376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:02.121791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2dad1-3b74-4fe1-b708-407406dfa9a3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:02.128878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5908ca-72b1-4e33-ac8d-63e2d5d165d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:02.130661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5908ca-72b1-4e33-ac8d-63e2d5d165d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:02.131267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5908ca-72b1-4e33-ac8d-63e2d5d165d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:02.131993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5908ca-72b1-4e33-ac8d-63e2d5d165d7 admin admin] PATH_INFO: `/v3/projects/5614bcab70884aa4a536b10904f81d7e/users/8563269cd54e4978859e9216a0520704/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:02.153522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5908ca-72b1-4e33-ac8d-63e2d5d165d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5614bcab70884aa4a536b10904f81d7e, user_id=8563269cd54e4978859e9216a0520704, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:02.156601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5908ca-72b1-4e33-ac8d-63e2d5d165d7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:02.188959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 925/1857] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:02 2022] PUT /identity/v3/projects/5614bcab70884aa4a536b10904f81d7e/users/8563269cd54e4978859e9216a0520704/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:02.191066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0132-13c4-40bd-b10a-47fc10fab81a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:02.191364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0132-13c4-40bd-b10a-47fc10fab81a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:02.191646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c0132-13c4-40bd-b10a-47fc10fab81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:02.206478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 933/1858] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:02.211658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ea1eb-64eb-46e1-ade5-f19052287259 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:02.231811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f26c0132-13c4-40bd-b10a-47fc10fab81a None None] MFA Rules not processed for user `8563269cd54e4978859e9216a0520704`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:02.233446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f26c0132-13c4-40bd-b10a-47fc10fab81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:02.235842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ea1eb-64eb-46e1-ade5-f19052287259 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:02.367895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 926/1859] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:02.372682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0132-13c4-40bd-b10a-47fc10fab81a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:02.399199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:02.401668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:02.402052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:02.402365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:02.403073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:02.405222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:02.537490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 934/1860] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:02 2022] POST /identity/v3/projects => generated 377 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:02.539256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:02.566065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26c0132-13c4-40bd-b10a-47fc10fab81a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:02.652949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:02.663468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9577cd1-a7b9-4ad1-9f1b-0ca68eae9389 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:02.672029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b08b6-0eb5-4ca4-a4e4-57d4fa4f4c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:02.673011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b08b6-0eb5-4ca4-a4e4-57d4fa4f4c3b service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:02.673965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b08b6-0eb5-4ca4-a4e4-57d4fa4f4c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:02.675028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b08b6-0eb5-4ca4-a4e4-57d4fa4f4c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:02.677647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e0b08b6-0eb5-4ca4-a4e4-57d4fa4f4c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:02.724453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:02.756786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:02.757842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:02.758278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:02.758655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:02.759572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:02.761698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:02.808361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b08b6-0eb5-4ca4-a4e4-57d4fa4f4c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:02.812410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b08b6-0eb5-4ca4-a4e4-57d4fa4f4c3b service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:02.833891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 927/1861] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:02 2022] POST /identity/v3/projects => generated 369 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:02.836922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:02.842893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 935/1862] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:02.845161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980e5e-7ee4-4657-b7a0-92e8120babb0 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:02.845552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980e5e-7ee4-4657-b7a0-92e8120babb0 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:02.846210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be980e5e-7ee4-4657-b7a0-92e8120babb0 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:02.848712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 936/1863] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:56:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:56:02.849760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be980e5e-7ee4-4657-b7a0-92e8120babb0 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.025225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be980e5e-7ee4-4657-b7a0-92e8120babb0 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.033284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04063-8d8f-4c8a-b97d-95484b61a314 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.038517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58930c7-40da-464d-9afc-27c1855d9068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.039569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58930c7-40da-464d-9afc-27c1855d9068 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.040032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58930c7-40da-464d-9afc-27c1855d9068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.040592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58930c7-40da-464d-9afc-27c1855d9068 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.042415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58930c7-40da-464d-9afc-27c1855d9068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.044227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.046552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.047029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58930c7-40da-464d-9afc-27c1855d9068 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.048065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.048497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.051665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.063326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.109071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 937/1864] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:02 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:03.109330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 928/1865] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:02 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:03.109428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990910-be6e-4ded-b5f5-dc02a97f6781 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.109428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990910-be6e-4ded-b5f5-dc02a97f6781 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.109428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990910-be6e-4ded-b5f5-dc02a97f6781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.111671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.136236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c7dc-ae55-4003-8102-abc044de9d1f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.144265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.145076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.146058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.146339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.147674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.155639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.160174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d3990910-be6e-4ded-b5f5-dc02a97f6781 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:03.163509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d3990910-be6e-4ded-b5f5-dc02a97f6781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:03.185098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 929/1866] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:03.187394 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.206587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130a6fe-14c6-4897-8e59-808e58691bf3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.211456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.212329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.212528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.212760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.213561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.215132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.232453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 930/1867] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:03.232453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.242132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4d2d9-0efa-47bf-b07c-5d84512d2b99 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.248325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.248992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.249282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.249564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.250226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.253117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.269478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 931/1868] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:03.270688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.285329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b42e2c-cf31-4d4d-9113-4065b74e66f9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.291526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.292598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.292892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.293181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] PATH_INFO: `/v3/projects/e861a7c5d9f942349ea37f89542a6fc3/users/2dec357dfc974415ae09bd29d90b6e9d/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.312837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e861a7c5d9f942349ea37f89542a6fc3, user_id=2dec357dfc974415ae09bd29d90b6e9d, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.319123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.339805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 932/1869] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:03 2022] PUT /identity/v3/projects/e861a7c5d9f942349ea37f89542a6fc3/users/2dec357dfc974415ae09bd29d90b6e9d/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:03.342534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.360614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 938/1870] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:03.362106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3990910-be6e-4ded-b5f5-dc02a97f6781 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.388039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3990910-be6e-4ded-b5f5-dc02a97f6781 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.464491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:03.468539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81f0fc-96df-4618-a79f-1c8ff3dd40ed admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.474339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22557e8-c729-43f6-af91-36af6e8b5836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.475175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22557e8-c729-43f6-af91-36af6e8b5836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.475459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22557e8-c729-43f6-af91-36af6e8b5836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.475801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22557e8-c729-43f6-af91-36af6e8b5836 admin admin] PATH_INFO: `/v3/projects/8817c4999c3e4167a5436d03b9037590/users/d50780bd9a0a4f02b2a4b36e322a191b/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.480997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:03.523813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22557e8-c729-43f6-af91-36af6e8b5836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8817c4999c3e4167a5436d03b9037590, user_id=d50780bd9a0a4f02b2a4b36e322a191b, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.527477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22557e8-c729-43f6-af91-36af6e8b5836 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.561930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.562823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.563261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.563686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.564577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.566515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.570772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 933/1871] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:03 2022] PUT /identity/v3/projects/8817c4999c3e4167a5436d03b9037590/users/d50780bd9a0a4f02b2a4b36e322a191b/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:03.587177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb08c6-6bd8-43f8-85ac-d2dbad7929d5 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.587177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb08c6-6bd8-43f8-85ac-d2dbad7929d5 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.587386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb08c6-6bd8-43f8-85ac-d2dbad7929d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.591518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 939/1872] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:03.597375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.620269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f71033-544b-40ed-bc9b-7c6afb60fc35 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.635994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e4eb08c6-6bd8-43f8-85ac-d2dbad7929d5 None None] MFA Rules not processed for user `d50780bd9a0a4f02b2a4b36e322a191b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:03.640691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e4eb08c6-6bd8-43f8-85ac-d2dbad7929d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:03.741397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.742855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.742855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.742855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] PATH_INFO: `/v3/projects/e861a7c5d9f942349ea37f89542a6fc3/users/2dec357dfc974415ae09bd29d90b6e9d/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.745217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e861a7c5d9f942349ea37f89542a6fc3, user_id=2dec357dfc974415ae09bd29d90b6e9d, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.747639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:03.762220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 940/1873] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:03 2022] PUT /identity/v3/projects/e861a7c5d9f942349ea37f89542a6fc3/users/2dec357dfc974415ae09bd29d90b6e9d/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:03.763358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:03.765521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:03.871865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 934/1874] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:03.873628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e24699-1b6b-4e1b-ae35-826362fe720e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.873829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e24699-1b6b-4e1b-ae35-826362fe720e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.874700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e24699-1b6b-4e1b-ae35-826362fe720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.920409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-76e24699-1b6b-4e1b-ae35-826362fe720e None None] MFA Rules not processed for user `2dec357dfc974415ae09bd29d90b6e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:03.922519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-76e24699-1b6b-4e1b-ae35-826362fe720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:03.945938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be03251-d989-4cab-8e3c-de14656934ee admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:03.966482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:03.967164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:03.967595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:03.967804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:03.992014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:03.993892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:04.049552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 941/1875] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:04.061093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:04.227563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 935/1876] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:04.240544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e24699-1b6b-4e1b-ae35-826362fe720e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:04.246724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:04.304009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95626-a727-4abd-a065-9d78a8e97978 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:04.332299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:04.332973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:04.333259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:04.333539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:04.334342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:04.339358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:04.429044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 942/1877] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:04 2022] POST /identity/v3/projects => generated 377 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:04.432364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:04.540438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e24699-1b6b-4e1b-ae35-826362fe720e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:04.594723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:04.680164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9ed5-47c4-438d-8d6d-f0ae6dea5b71 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:04.699502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:04.703343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:04.703706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:04.704000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:04.704918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:04.712041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:04.728737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:04.729364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:04.729643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:04.729919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:04.772840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 943/1878] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:04 2022] POST /identity/v3/users => generated 295 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:04.774641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:04.819680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9b9ed-ca31-4be8-ba83-e3e1313333b6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:04.836788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:04.837722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:04.840231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:04.841149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:04.843002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:04.851781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:04.881377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 944/1879] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:04.886251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:04.925279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b78ed-49a7-4dd8-874f-396d78bc8bdc admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:04.936957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:04.939213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:04.959645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:04.961427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:04.961427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:04.961427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] PATH_INFO: `/v3/projects/ab6cf41de26e467fa28f5e5a27bf17da/users/219292307cf3483285e28da77ff3bc92/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:04.977969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 936/1880] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:05.009190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6cf41de26e467fa28f5e5a27bf17da, user_id=219292307cf3483285e28da77ff3bc92, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:05.012058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:05.046238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 945/1881] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:04 2022] PUT /identity/v3/projects/ab6cf41de26e467fa28f5e5a27bf17da/users/219292307cf3483285e28da77ff3bc92/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:05.047585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:05.049709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:05.062276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd223563-e82b-4eb3-9593-93aee1c48e8c service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:05.170594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06344e8-847c-4056-b3e2-3fe76bbe6e6a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:05.178751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:05.179494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:05.179717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:05.180002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:05.180834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:05.182813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:05.204195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:05.205248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:05.205692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:05.206078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:05.223972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 946/1882] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:05.223972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:05.242308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef05bbe-83b2-46ae-be05-8c86b49c5373 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:05.252625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec358a-d4ec-489c-85c5-a507ac0fa3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:05.253623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec358a-d4ec-489c-85c5-a507ac0fa3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:05.253915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec358a-d4ec-489c-85c5-a507ac0fa3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:05.254198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec358a-d4ec-489c-85c5-a507ac0fa3cf admin admin] PATH_INFO: `/v3/projects/ab6cf41de26e467fa28f5e5a27bf17da/users/219292307cf3483285e28da77ff3bc92/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:05.257341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec358a-d4ec-489c-85c5-a507ac0fa3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6cf41de26e467fa28f5e5a27bf17da, user_id=219292307cf3483285e28da77ff3bc92, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:05.261180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec358a-d4ec-489c-85c5-a507ac0fa3cf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:05.278047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 947/1883] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:05 2022] PUT /identity/v3/projects/ab6cf41de26e467fa28f5e5a27bf17da/users/219292307cf3483285e28da77ff3bc92/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:05.289196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1c98-03e0-43f6-9208-1b0d5309cb56 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:05.289897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1c98-03e0-43f6-9208-1b0d5309cb56 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:05.290349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e1c98-03e0-43f6-9208-1b0d5309cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:05.301040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:05.333652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:05.335133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:05.335370 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e84e1c98-03e0-43f6-9208-1b0d5309cb56 None None] MFA Rules not processed for user `219292307cf3483285e28da77ff3bc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:05.336737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e84e1c98-03e0-43f6-9208-1b0d5309cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:05.345058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 937/1884] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:05.444257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 948/1885] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:05.457027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:05.458607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:05.474755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb25d55-ef43-4633-a6a6-d1721c166792 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:05.492588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:05.536862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:05.537407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:05.537698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:05.538311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:05.550718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:05.552219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:05.563539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 938/1886] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:05.643303 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1c98-03e0-43f6-9208-1b0d5309cb56 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:05.664022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e1c98-03e0-43f6-9208-1b0d5309cb56 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:05.670548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:05.671431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:05.671714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:05.672365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:05.770704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:05.776733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:05.805709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 949/1887] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:07.880550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:07.893443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45230841-7fb7-44f2-af07-ec9fc79cda40 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:07.899514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:07.900482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:07.900968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:07.901425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:07.903589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:08.025271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:08.026864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:08.036751 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 939/1888] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:09.244249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:09.353015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec5247-bfac-4223-a7de-b55d1fab54f3 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:09.358592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:09.359337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:09.359791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:09.360251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] PATH_INFO: `/v3/users/b8fc393260564ae487d0384dbdf39eb6` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:09.362204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fc393260564ae487d0384dbdf39eb6)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:09.364595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:09.408649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:09.435439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fc393260564ae487d0384dbdf39eb6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.436735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fc393260564ae487d0384dbdf39eb6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.450265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fc393260564ae487d0384dbdf39eb6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.450627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fc393260564ae487d0384dbdf39eb6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.480470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-29651313-dbde-4ba7-b35e-9a18ebf668c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fc393260564ae487d0384dbdf39eb6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.483514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:09.499254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688b6d1-36a0-4e83-bb81-32009bc3bd3f service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:09.509758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 950/1889] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:09 2022] DELETE /identity/v3/users/b8fc393260564ae487d0384dbdf39eb6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:09.511813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:09.512246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7001459-ea3d-4112-957c-cb367515314b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:09.512579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7001459-ea3d-4112-957c-cb367515314b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:09.513016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7001459-ea3d-4112-957c-cb367515314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:09.513698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:09.514453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:09.514959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] PATH_INFO: `/v3/users/8563269cd54e4978859e9216a0520704` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:09.516657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8563269cd54e4978859e9216a0520704)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:09.519910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:09.542352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e7001459-ea3d-4112-957c-cb367515314b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:09.544311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e7001459-ea3d-4112-957c-cb367515314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:09.652465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 951/1890] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:09.664963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7001459-ea3d-4112-957c-cb367515314b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:09.667421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e7001459-ea3d-4112-957c-cb367515314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:09.675016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8563269cd54e4978859e9216a0520704'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.675770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8563269cd54e4978859e9216a0520704'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.676453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8563269cd54e4978859e9216a0520704'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.684696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8563269cd54e4978859e9216a0520704'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.701848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f0007442-eb31-46fc-910e-d2fce32390f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8563269cd54e4978859e9216a0520704'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:09.728895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 940/1891] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:09 2022] DELETE /identity/v3/users/8563269cd54e4978859e9216a0520704 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:09.738883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:09.740846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:09.741364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:09.759697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7001459-ea3d-4112-957c-cb367515314b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:09.778761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:09.780270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:09.818852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:09.827750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb619-d175-430d-a7b4-21f02aca493e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:09.828342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb619-d175-430d-a7b4-21f02aca493e service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:09.828676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb619-d175-430d-a7b4-21f02aca493e service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:09.828964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb619-d175-430d-a7b4-21f02aca493e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:09.830975 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-248bb619-d175-430d-a7b4-21f02aca493e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:09.848700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:09.864361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 941/1892] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:09.882920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:09.884252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:09.896841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cce7f4-8277-4eb2-ab49-6c336f28472a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:09.900643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:09.901329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:09.901618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:09.901945 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:09.912869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:09.913330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb619-d175-430d-a7b4-21f02aca493e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:09.914341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:09.915114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb619-d175-430d-a7b4-21f02aca493e service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:09.926221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 942/1893] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:56:09.930087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 952/1894] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:10.018517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:10.020852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:10.043000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4570f-2884-4944-9aad-f76170bb7b44 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:10.060506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:10.061514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:10.062539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:10.063068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] PATH_INFO: `/v3/users/9f540e751c8d4d058939e97b78d96d60` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:10.065724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f540e751c8d4d058939e97b78d96d60)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:10.070527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:10.187342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f540e751c8d4d058939e97b78d96d60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.189626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f540e751c8d4d058939e97b78d96d60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.191187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f540e751c8d4d058939e97b78d96d60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.208350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f540e751c8d4d058939e97b78d96d60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.220352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f540e751c8d4d058939e97b78d96d60'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.272594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:10.273114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:10.273210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:10.276441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 943/1895] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:10 2022] DELETE /identity/v3/users/9f540e751c8d4d058939e97b78d96d60 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:10.299704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:10.302022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:10.393648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 953/1896] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:10.412152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:10.414088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:10.498879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef14df-526e-4996-b33f-d256bd7edb0d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:10.503953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:10.504801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:10.505224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:10.505637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:10.517196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:10.519538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:10.531513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 944/1897] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:10.539621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:10.541530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:10.555824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966242a-dda9-45e3-927a-595ccc2c469e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:10.561731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:10.563834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:10.563834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:10.563834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] PATH_INFO: `/v3/projects/5614bcab70884aa4a536b10904f81d7e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:10.565687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5614bcab70884aa4a536b10904f81d7e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:10.569620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:10.689497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5614bcab70884aa4a536b10904f81d7e', 'request_id': 'req-8d216845-856b-40d1-979e-92c31c50f8f1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.708373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5614bcab70884aa4a536b10904f81d7e', 'request_id': 'req-8d216845-856b-40d1-979e-92c31c50f8f1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.726766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5614bcab70884aa4a536b10904f81d7e', 'request_id': 'req-8d216845-856b-40d1-979e-92c31c50f8f1'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.750263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] The token cache is being invalidate because project 5614bcab70884aa4a536b10904f81d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:10.750743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.751914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.755256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 954/1898] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:10 2022] DELETE /identity/v3/projects/5614bcab70884aa4a536b10904f81d7e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:10.758914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:10.770576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eceec4-039f-4933-a4b3-12c9c8c98f4e service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:10.842493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:10.851216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:10.852998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:10.894577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:10.895516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:10.895971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:10.896482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] PATH_INFO: `/v3/users/2dec357dfc974415ae09bd29d90b6e9d` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:10.898422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dec357dfc974415ae09bd29d90b6e9d)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:10.902178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:10.917375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:10.959732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216845-856b-40d1-979e-92c31c50f8f1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:10.965544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:10.966200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:10.966484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:10.967144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] PATH_INFO: `/v3/projects/15a80c4478f74e638c59385bd2692f13` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:10.967965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a80c4478f74e638c59385bd2692f13)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:10.970204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:10.972373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dec357dfc974415ae09bd29d90b6e9d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.973244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dec357dfc974415ae09bd29d90b6e9d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:10.973984 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dec357dfc974415ae09bd29d90b6e9d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.000714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dec357dfc974415ae09bd29d90b6e9d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.016579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dec357dfc974415ae09bd29d90b6e9d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.056033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 945/1899] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:10 2022] DELETE /identity/v3/users/2dec357dfc974415ae09bd29d90b6e9d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:11.057086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:11.061251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:11.065279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a80c4478f74e638c59385bd2692f13', 'request_id': 'req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.071898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a80c4478f74e638c59385bd2692f13', 'request_id': 'req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.080604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a80c4478f74e638c59385bd2692f13', 'request_id': 'req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.099629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] The token cache is being invalidate because project 15a80c4478f74e638c59385bd2692f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:11.100582 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.101331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.107093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 955/1900] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:10 2022] DELETE /identity/v3/projects/15a80c4478f74e638c59385bd2692f13 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:11.108157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:11.110202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:11.188504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfba9d-3940-4e29-8c05-0b07cdc37137 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:11.196250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:11.197301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:11.198925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:11.199419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] PATH_INFO: `/v3/users/54f1e2f4aa8c4646a1c3070b38fb9506` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:11.201215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f1e2f4aa8c4646a1c3070b38fb9506)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:11.203512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:11.218110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37c3cb-fdc2-4b9f-9c9c-e9003073f1ea admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:11.225472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:11.226229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:11.226588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:11.227650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] PATH_INFO: `/v3/users/d50780bd9a0a4f02b2a4b36e322a191b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:11.228954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50780bd9a0a4f02b2a4b36e322a191b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:11.231158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:11.299798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50780bd9a0a4f02b2a4b36e322a191b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.301296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50780bd9a0a4f02b2a4b36e322a191b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.315510 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f1e2f4aa8c4646a1c3070b38fb9506'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.316882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f1e2f4aa8c4646a1c3070b38fb9506'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.317891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50780bd9a0a4f02b2a4b36e322a191b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.318506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f1e2f4aa8c4646a1c3070b38fb9506'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.319044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50780bd9a0a4f02b2a4b36e322a191b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.328717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:11.334037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f1e2f4aa8c4646a1c3070b38fb9506'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.341751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50780bd9a0a4f02b2a4b36e322a191b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.344650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7c49ce94-5981-47e3-adf3-058a6d807b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f1e2f4aa8c4646a1c3070b38fb9506'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.356052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:11.369853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 946/1901] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:11 2022] DELETE /identity/v3/users/54f1e2f4aa8c4646a1c3070b38fb9506 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:11.381155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 956/1902] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:11 2022] DELETE /identity/v3/users/d50780bd9a0a4f02b2a4b36e322a191b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:11.383029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:11.384069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:11.385846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:11.412370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:11.415168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:11.482817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:11.485327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:11.614123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 947/1903] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:11.634455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d339ae-d1bc-4817-9274-59b802b63c26 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:11.647364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:11.650019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:11.657929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:11.660426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:11.660721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:11.660994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] PATH_INFO: `/v3/projects/ab8cabaea4bf4651a609712c2e43823f` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:11.663877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8cabaea4bf4651a609712c2e43823f)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:11.676820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:11.774761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8cabaea4bf4651a609712c2e43823f', 'request_id': 'req-5b7d4c95-f4b4-45e0-9755-6bfb467be205'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.792124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8cabaea4bf4651a609712c2e43823f', 'request_id': 'req-5b7d4c95-f4b4-45e0-9755-6bfb467be205'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.806065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8cabaea4bf4651a609712c2e43823f', 'request_id': 'req-5b7d4c95-f4b4-45e0-9755-6bfb467be205'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.814419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190b158-eaf6-41c9-bf1d-54c6cb7aea58 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:11.830287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] The token cache is being invalidate because project ab8cabaea4bf4651a609712c2e43823f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:11.831266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.833102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:11.847539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 957/1904] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:11 2022] DELETE /identity/v3/projects/ab8cabaea4bf4651a609712c2e43823f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:11.852022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:11.862585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:11.907580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:11.908691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:11.908972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:11.909358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:11.911148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:11.981353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:12.008751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d4c95-f4b4-45e0-9755-6bfb467be205 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:12.014108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:12.014829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.015211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.015558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] PATH_INFO: `/v3/users/d41f5e8e036e49e5bc9773b1559078c7` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.016977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41f5e8e036e49e5bc9773b1559078c7)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.019605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:12.022164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.024105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:12.045915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:12.058437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 948/1905] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:12.059434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:12.065700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:12.105390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46ec8-9d86-4ade-9620-12a28f959738 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:12.112619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41f5e8e036e49e5bc9773b1559078c7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.116767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41f5e8e036e49e5bc9773b1559078c7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.136575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:12.137636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.137854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.138141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] PATH_INFO: `/v3/projects/e861a7c5d9f942349ea37f89542a6fc3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.141118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41f5e8e036e49e5bc9773b1559078c7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.142747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41f5e8e036e49e5bc9773b1559078c7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.142901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e861a7c5d9f942349ea37f89542a6fc3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.144731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:12.165048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41f5e8e036e49e5bc9773b1559078c7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.205219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 958/1906] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:11 2022] DELETE /identity/v3/users/d41f5e8e036e49e5bc9773b1559078c7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:12.206185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:12.211734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:12.230275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e861a7c5d9f942349ea37f89542a6fc3', 'request_id': 'req-a4f6855d-d374-4be4-b177-ff51bb54da44'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.238081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e861a7c5d9f942349ea37f89542a6fc3', 'request_id': 'req-a4f6855d-d374-4be4-b177-ff51bb54da44'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.266823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e861a7c5d9f942349ea37f89542a6fc3', 'request_id': 'req-a4f6855d-d374-4be4-b177-ff51bb54da44'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.286586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] The token cache is being invalidate because project e861a7c5d9f942349ea37f89542a6fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:12.287687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.289221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a4f6855d-d374-4be4-b177-ff51bb54da44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.291082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 949/1907] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:12 2022] DELETE /identity/v3/projects/e861a7c5d9f942349ea37f89542a6fc3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:12.296490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51960e2-7788-4784-858c-6b862ff3d790 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.296777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51960e2-7788-4784-858c-6b862ff3d790 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.297051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51960e2-7788-4784-858c-6b862ff3d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.310600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173306-279d-4a55-b5df-34b833a30c7f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:12.322243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d51960e2-7788-4784-858c-6b862ff3d790 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:12.335406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d51960e2-7788-4784-858c-6b862ff3d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:12.399671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:12.400503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.400886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.401382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] PATH_INFO: `/v3/projects/8817c4999c3e4167a5436d03b9037590` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.402708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8817c4999c3e4167a5436d03b9037590)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.405795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:12.476513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 950/1908] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:12.478994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf574-ff79-42a4-8e30-0ab3401715e4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.479452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf574-ff79-42a4-8e30-0ab3401715e4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.479806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cf574-ff79-42a4-8e30-0ab3401715e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.503798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:12.504554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c90cf574-ff79-42a4-8e30-0ab3401715e4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:12.505851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c90cf574-ff79-42a4-8e30-0ab3401715e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:12.513163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8817c4999c3e4167a5436d03b9037590', 'request_id': 'req-c6a631c7-9d79-486a-8638-1efce4f3dc6a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.526896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8817c4999c3e4167a5436d03b9037590', 'request_id': 'req-c6a631c7-9d79-486a-8638-1efce4f3dc6a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.543538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8817c4999c3e4167a5436d03b9037590', 'request_id': 'req-c6a631c7-9d79-486a-8638-1efce4f3dc6a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.565464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] The token cache is being invalidate because project 8817c4999c3e4167a5436d03b9037590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:12.566404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.569081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.578415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 959/1909] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:12 2022] DELETE /identity/v3/projects/8817c4999c3e4167a5436d03b9037590 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:12.581057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:12.585021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:12.601309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 951/1910] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:12.604610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cf574-ff79-42a4-8e30-0ab3401715e4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:12.617062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:12.625764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cf574-ff79-42a4-8e30-0ab3401715e4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:12.633061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:12.633769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.634230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.635133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.635133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:12.635508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.638082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:12.654489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 952/1911] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:12.660345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:12.673351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a81ceb-941a-42f5-a4d5-734ee26de262 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:12.675436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a631c7-9d79-486a-8638-1efce4f3dc6a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:12.680904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:12.681479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.681750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:12.681891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.682056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.682400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.682740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.682932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.683165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] PATH_INFO: `/v3/users/219292307cf3483285e28da77ff3bc92` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.684678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:12.684789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=219292307cf3483285e28da77ff3bc92)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.686642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:12.729375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 953/1912] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:12 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:12.733453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:12.761447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219292307cf3483285e28da77ff3bc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.762589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219292307cf3483285e28da77ff3bc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.775550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219292307cf3483285e28da77ff3bc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.777430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219292307cf3483285e28da77ff3bc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.793029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219292307cf3483285e28da77ff3bc92'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:12.820690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 960/1913] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:12 2022] DELETE /identity/v3/users/219292307cf3483285e28da77ff3bc92 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:12.829783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a07bf-116f-46ae-8e26-f1f26ae01c5e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:12.974627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:12.975207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:12.975539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:12.975822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:12.976569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:12.978801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.010781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 954/1914] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:12 2022] POST /identity/v3/users => generated 285 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:13.014242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.015765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:13.049475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578168f7-fd2b-41c0-a407-687858763006 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:13.071247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:13.071908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.075583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.076102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.076983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:13.086341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.102453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 961/1915] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:13.110007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.129435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb037e-bfb2-416d-980b-b12a1eb557c9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:13.146454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068907e-b7c5-4332-bfeb-bfc80a4c131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:13.149702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068907e-b7c5-4332-bfeb-bfc80a4c131c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.150516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068907e-b7c5-4332-bfeb-bfc80a4c131c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.151260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068907e-b7c5-4332-bfeb-bfc80a4c131c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.153341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068907e-b7c5-4332-bfeb-bfc80a4c131c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:13.156303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068907e-b7c5-4332-bfeb-bfc80a4c131c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.173098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 955/1916] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:13.178630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.199592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce916b3-f78d-4134-b73b-44b4a552d9c9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:13.209242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:13.211542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.212410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.213144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] PATH_INFO: `/v3/projects/89ed5eb1fb0e4040aae72e1626de4ac4/users/d0ab0630297b45cc8eb09ef625810aee/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.236036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ed5eb1fb0e4040aae72e1626de4ac4, user_id=d0ab0630297b45cc8eb09ef625810aee, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:13.241401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.256438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 962/1917] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:13 2022] PUT /identity/v3/projects/89ed5eb1fb0e4040aae72e1626de4ac4/users/d0ab0630297b45cc8eb09ef625810aee/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:13.261989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.262456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.263275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.291425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:13.292954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:13.366933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:13.385175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 956/1918] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:13.421849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.423898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:13.450430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:13.465356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.467555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:13.484313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ae298-dba8-4476-8079-597f31ce2599 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:13.497832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:13.499048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.499625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.500752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] PATH_INFO: `/v3/projects/e80239301bec485fada3976efa875d02` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.505270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80239301bec485fada3976efa875d02)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:13.511392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.576345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53abcaa-1999-4cc3-8d5b-4e09208c9e9e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:13.588813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:13.590899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.591383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.592072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.612165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:13.613502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.625885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 963/1919] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:13.640963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80239301bec485fada3976efa875d02', 'request_id': 'req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.648080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80239301bec485fada3976efa875d02', 'request_id': 'req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.658640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80239301bec485fada3976efa875d02', 'request_id': 'req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.672857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] The token cache is being invalidate because project e80239301bec485fada3976efa875d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:13.673160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.674859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.677025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 957/1920] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:13 2022] DELETE /identity/v3/projects/e80239301bec485fada3976efa875d02 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:13.681247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.692329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca385e0-21b3-447c-a1eb-384dc4ae181c service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:13.763178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.764932 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:13.769078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:13.769721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.770009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.770287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] PATH_INFO: `/v3/users/ca8d474ecdeb4bf5a79c7b2cb0ff8b9d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.771588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8d474ecdeb4bf5a79c7b2cb0ff8b9d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:13.773620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.782682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe313e3-6eb6-46a3-a97a-71787a84bc0e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:13.789997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:13.793058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.793390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.794364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] PATH_INFO: `/v3/projects/1d294061a16140bca2334ea75ae716e9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.796489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d294061a16140bca2334ea75ae716e9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:13.800896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:13.854728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8d474ecdeb4bf5a79c7b2cb0ff8b9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.855599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8d474ecdeb4bf5a79c7b2cb0ff8b9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.866285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8d474ecdeb4bf5a79c7b2cb0ff8b9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.867617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8d474ecdeb4bf5a79c7b2cb0ff8b9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.879851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8d474ecdeb4bf5a79c7b2cb0ff8b9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.893584 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d294061a16140bca2334ea75ae716e9', 'request_id': 'req-d21ccf8f-8995-4b3b-9f19-8513d96261d6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.899889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d294061a16140bca2334ea75ae716e9', 'request_id': 'req-d21ccf8f-8995-4b3b-9f19-8513d96261d6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.913768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d294061a16140bca2334ea75ae716e9', 'request_id': 'req-d21ccf8f-8995-4b3b-9f19-8513d96261d6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.923446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 964/1921] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:13 2022] DELETE /identity/v3/users/ca8d474ecdeb4bf5a79c7b2cb0ff8b9d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:13.925116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:13.927065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:13.943071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] The token cache is being invalidate because project 1d294061a16140bca2334ea75ae716e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:13.943646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.945397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d21ccf8f-8995-4b3b-9f19-8513d96261d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:13.951326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 958/1922] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:13 2022] DELETE /identity/v3/projects/1d294061a16140bca2334ea75ae716e9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:13.956169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6def0b-89a4-4597-bbf4-de305ff3200f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:13.956590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6def0b-89a4-4597-bbf4-de305ff3200f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:13.956884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6def0b-89a4-4597-bbf4-de305ff3200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:13.995341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:14.047120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-dc6def0b-89a4-4597-bbf4-de305ff3200f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:14.054115 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dc6def0b-89a4-4597-bbf4-de305ff3200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:14.060463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a4ae8-fa98-47db-944f-1d215285c4e4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.074077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.074819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.075022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.080442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 959/1923] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:14.080598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] PATH_INFO: `/v3/projects/ab6cf41de26e467fa28f5e5a27bf17da` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.080598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6cf41de26e467fa28f5e5a27bf17da)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.080762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.083927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47b335-8679-4098-8072-99d065e91781 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.084226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47b335-8679-4098-8072-99d065e91781 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.084557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47b335-8679-4098-8072-99d065e91781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.125824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6d47b335-8679-4098-8072-99d065e91781 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:14.129399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6d47b335-8679-4098-8072-99d065e91781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:14.151405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 960/1924] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:14.153812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47b335-8679-4098-8072-99d065e91781 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.168216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47b335-8679-4098-8072-99d065e91781 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.176525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6cf41de26e467fa28f5e5a27bf17da', 'request_id': 'req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:14.192599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6cf41de26e467fa28f5e5a27bf17da', 'request_id': 'req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:14.208496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6cf41de26e467fa28f5e5a27bf17da', 'request_id': 'req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:14.231771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] The token cache is being invalidate because project ab6cf41de26e467fa28f5e5a27bf17da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:14.232097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:14.233420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:14.234918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-58302c73-9c51-4ab6-ae3b-8c6a9bb3743b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:14.238876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 965/1925] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:13 2022] DELETE /identity/v3/projects/ab6cf41de26e467fa28f5e5a27bf17da => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:14.246702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62a65d-8603-4060-b105-c635020d4aed None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.247076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62a65d-8603-4060-b105-c635020d4aed None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.247410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62a65d-8603-4060-b105-c635020d4aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.251435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.252416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.252736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.253176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.254362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:14.254820 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.257590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.294168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 961/1926] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:14.297756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1e62a65d-8603-4060-b105-c635020d4aed None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:14.301292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.301547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1e62a65d-8603-4060-b105-c635020d4aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:14.301639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:14.312429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 966/1927] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:14.320891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89a3ed-3698-490e-bc68-85197b9b4b6e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.321553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89a3ed-3698-490e-bc68-85197b9b4b6e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.324209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89a3ed-3698-490e-bc68-85197b9b4b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.331483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e67aa7-81c5-488a-936a-93c19a30773f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.344905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.346322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.347182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.348182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.349012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.352415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.371375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cf89a3ed-3698-490e-bc68-85197b9b4b6e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:14.372994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cf89a3ed-3698-490e-bc68-85197b9b4b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:14.385727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 967/1928] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:14.387479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89a3ed-3698-490e-bc68-85197b9b4b6e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.404365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89a3ed-3698-490e-bc68-85197b9b4b6e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.410323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.410900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.411255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.411453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.412110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:14.412455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.417650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.420108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 962/1929] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:14 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:14.421678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.441200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 968/1930] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:14.443252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.465744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783dba-5d73-4faa-abcb-487373b3ee55 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.528697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daed9a7-7683-44a1-8e52-3ab5fc1d6259 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.541612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.542304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.542595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.543040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.544349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.547178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.591840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 963/1931] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:14 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:14.594078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.607644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.608421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.608754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.609075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.609790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.616655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.617509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc06744-2ba7-45d5-9944-c8a80e61b9eb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.628624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.629297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.629602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.629955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.630549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.632343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.671748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 969/1932] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:14 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:14.673363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.676492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 964/1933] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:14.678695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.690391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248afb-c56d-4d36-995d-4f54965118ab admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.733248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:14.796037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.797229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.799333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.799850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.800781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.802734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.810311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c9b6-bc57-4fc0-91f9-e6df551f96d9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.816910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 965/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:14.822468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.825078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.826253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.826701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.827069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.827835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.833146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.837694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a22f1-6f36-46c1-8308-c4e17b1bd980 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.844872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:14.846400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:14.847063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:14.847566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] PATH_INFO: `/v3/projects/0eb80ca8bcdc455fbe68170a90a8ea4e/users/2bab642623504e15ad7bfe9404208eaf/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:14.868110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb80ca8bcdc455fbe68170a90a8ea4e, user_id=2bab642623504e15ad7bfe9404208eaf, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:14.873731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 970/1935] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:14 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:14.873895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:14.875056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.893453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1578760-1fa8-4aad-a319-6bf350639eb4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:14.902624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 966/1936] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:14 2022] PUT /identity/v3/projects/0eb80ca8bcdc455fbe68170a90a8ea4e/users/2bab642623504e15ad7bfe9404208eaf/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:14.902624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:14.904904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:14.927616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:15.009417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302058f-d71c-48ef-abe4-fd1b2b6be1b8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.015486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.016604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.017052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.018126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] PATH_INFO: `/v3/projects/c867ab172c60477e9a52283e8fd96d3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.019418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06be22-186e-4ad7-bd4b-9eb9680b8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.019552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c867ab172c60477e9a52283e8fd96d3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.020109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be22-186e-4ad7-bd4b-9eb9680b8b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.020482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be22-186e-4ad7-bd4b-9eb9680b8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.020765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be22-186e-4ad7-bd4b-9eb9680b8b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.021521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06be22-186e-4ad7-bd4b-9eb9680b8b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.021769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.023633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06be22-186e-4ad7-bd4b-9eb9680b8b41 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.039249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 971/1937] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:15.039249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667b4f-ba15-4cfe-b2d3-2d7ecb443398 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.039249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667b4f-ba15-4cfe-b2d3-2d7ecb443398 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.039249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667b4f-ba15-4cfe-b2d3-2d7ecb443398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.085493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6f667b4f-ba15-4cfe-b2d3-2d7ecb443398 None None] MFA Rules not processed for user `2bab642623504e15ad7bfe9404208eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:15.086767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6f667b4f-ba15-4cfe-b2d3-2d7ecb443398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.092954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c867ab172c60477e9a52283e8fd96d3f', 'request_id': 'req-857454de-8fa7-433a-9d8e-481be8de301e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.100417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c867ab172c60477e9a52283e8fd96d3f', 'request_id': 'req-857454de-8fa7-433a-9d8e-481be8de301e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.110251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c867ab172c60477e9a52283e8fd96d3f', 'request_id': 'req-857454de-8fa7-433a-9d8e-481be8de301e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.126397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] The token cache is being invalidate because project c867ab172c60477e9a52283e8fd96d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:15.127407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.128553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.134007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 967/1938] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:14 2022] DELETE /identity/v3/projects/c867ab172c60477e9a52283e8fd96d3f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:15.134007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.138183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.172907 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 972/1939] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:15.174722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.175073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.175437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.204269 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] MFA Rules not processed for user `d0ab0630297b45cc8eb09ef625810aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:15.205650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.219231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857454de-8fa7-433a-9d8e-481be8de301e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.225530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.226247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.226731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.227080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.227857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.229721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.244653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 968/1940] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:15.250401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.253531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.254889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:15.271402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092303f-ea74-4264-a880-64aafd97bb8e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.297304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.300937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.301237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.301633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] PATH_INFO: `/v3/users/f705310437924fe3a7fea37f34fface9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.302647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 973/1941] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:15.303007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f705310437924fe3a7fea37f34fface9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.303611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.305000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.306210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.321134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca3b51-cc4a-43e9-adfd-2f3009f1719c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.326552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.327385 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.327736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.328085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.328851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.331008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.354962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:15.381044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 974/1942] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:15 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:15.381044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.387575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f705310437924fe3a7fea37f34fface9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.388347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f705310437924fe3a7fea37f34fface9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.389092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f705310437924fe3a7fea37f34fface9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.421844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f705310437924fe3a7fea37f34fface9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.431865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f705310437924fe3a7fea37f34fface9'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.467181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d55347-5ec3-4d59-97e5-4d98470c6091 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.469676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 969/1943] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:15 2022] DELETE /identity/v3/users/f705310437924fe3a7fea37f34fface9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:15.470451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.472477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.565360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.567508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.568558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.569255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] PATH_INFO: `/v3/projects/3f74ea386aa540bab05cff85104282c0/users/fb09f34c5d104cab999a4cd6ec003449/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.571864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dabeae-f898-4e56-b8fa-1b018e0dcf02 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.588598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7602ec-bdfe-4291-860b-6f868a1fd2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.592116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7602ec-bdfe-4291-860b-6f868a1fd2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.592215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7602ec-bdfe-4291-860b-6f868a1fd2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.592484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7602ec-bdfe-4291-860b-6f868a1fd2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.593815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7602ec-bdfe-4291-860b-6f868a1fd2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.596374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7602ec-bdfe-4291-860b-6f868a1fd2e3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.601804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f74ea386aa540bab05cff85104282c0, user_id=fb09f34c5d104cab999a4cd6ec003449, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.605757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.624599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 975/1944] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:15 2022] PUT /identity/v3/projects/3f74ea386aa540bab05cff85104282c0/users/fb09f34c5d104cab999a4cd6ec003449/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:15.625557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.634493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.647575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 970/1945] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:15 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:15.648973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b72487-d7a8-4103-9b78-aef1eefb438a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.649247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b72487-d7a8-4103-9b78-aef1eefb438a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.649527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b72487-d7a8-4103-9b78-aef1eefb438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.686464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-82b72487-d7a8-4103-9b78-aef1eefb438a None None] MFA Rules not processed for user `fb09f34c5d104cab999a4cd6ec003449`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:15.687868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-82b72487-d7a8-4103-9b78-aef1eefb438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.701022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:15.731362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca351-366c-469e-9e37-564b51576474 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.773583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 971/1946] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:15.774226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b72487-d7a8-4103-9b78-aef1eefb438a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.803608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.804254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.804808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.804954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.805614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.806137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:15.808030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.836951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 976/1947] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:15 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:15.838813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.841095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.860039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b72487-d7a8-4103-9b78-aef1eefb438a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.865736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.866387 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.866669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.866942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.867572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.869536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.890540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 972/1948] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:15 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:15.891376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.893104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:15.905408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62c97c-9416-4de3-8afd-a7c6255d0a89 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.910756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.911389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.911673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.911950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] PATH_INFO: `/v3/projects/f9643715fcbf432eaba0eecaabb408d6` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.913245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9643715fcbf432eaba0eecaabb408d6)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.915201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.925445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b069d-2243-45d9-88f0-3b7e6e2eb1b2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.929295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a1ec98c3264279822a7b46fc20ac94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:15.929899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:15.930183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:15.930456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:15.938968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:15.940508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:15.951874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 977/1949] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:15.954153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:15.968258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a1d4f-ad69-4c7b-8dda-eb70d50cf05e service glance] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:15.976416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9643715fcbf432eaba0eecaabb408d6', 'request_id': 'req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.983267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9643715fcbf432eaba0eecaabb408d6', 'request_id': 'req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:15.998867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9643715fcbf432eaba0eecaabb408d6', 'request_id': 'req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:16.016365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] The token cache is being invalidate because project f9643715fcbf432eaba0eecaabb408d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:16.016771 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:16.018468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:16.020703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 973/1950] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:15 2022] DELETE /identity/v3/projects/f9643715fcbf432eaba0eecaabb408d6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:16.021680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.023151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:16.096138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d11715-f311-478c-92ac-7381a05f34d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.096744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11715-f311-478c-92ac-7381a05f34d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.097031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11715-f311-478c-92ac-7381a05f34d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.097493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d11715-f311-478c-92ac-7381a05f34d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.098393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d11715-f311-478c-92ac-7381a05f34d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.100174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d11715-f311-478c-92ac-7381a05f34d6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.101880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:16.117274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 978/1951] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:16.117274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.117274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.117274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.132839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30881d3f-d5ee-4d7f-99c9-ed5768ec588b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.144114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:16.145608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:16.145835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41a497-e5a7-43b6-8d96-7f09ba7d5fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.146497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a497-e5a7-43b6-8d96-7f09ba7d5fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.146784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a497-e5a7-43b6-8d96-7f09ba7d5fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.147123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a497-e5a7-43b6-8d96-7f09ba7d5fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.148490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41a497-e5a7-43b6-8d96-7f09ba7d5fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.150605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41a497-e5a7-43b6-8d96-7f09ba7d5fcf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.160543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 979/1952] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:16.161623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.163191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:16.170003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 974/1953] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:16.171431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772484-c10b-4143-a9ae-1be8ca1d3392 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.171729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772484-c10b-4143-a9ae-1be8ca1d3392 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.172012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772484-c10b-4143-a9ae-1be8ca1d3392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.181576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7fb6d-5722-431a-98dc-24cde4551124 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.191217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.192313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.192644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.192929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] PATH_INFO: `/v3/projects/697bcb75fd8b47708fbdc86886f23907/users/02bb326dbe6d405bb0133288c4b26498/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.202118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ee772484-c10b-4143-a9ae-1be8ca1d3392 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:16.204137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ee772484-c10b-4143-a9ae-1be8ca1d3392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:16.216113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 975/1954] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:16.217014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee772484-c10b-4143-a9ae-1be8ca1d3392 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.220671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697bcb75fd8b47708fbdc86886f23907, user_id=02bb326dbe6d405bb0133288c4b26498, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.229574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee772484-c10b-4143-a9ae-1be8ca1d3392 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.230694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.236623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.237415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.237623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.237864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] PATH_INFO: `/v3/projects/6580544e90f945cd8d7b7f839542d17a/users/535a70e1530e49969a2df5963f860415/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.260790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 980/1955] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:16 2022] PUT /identity/v3/projects/697bcb75fd8b47708fbdc86886f23907/users/02bb326dbe6d405bb0133288c4b26498/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:16.261166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6580544e90f945cd8d7b7f839542d17a, user_id=535a70e1530e49969a2df5963f860415, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.261804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.265660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.279723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:16.286624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 976/1956] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:16 2022] PUT /identity/v3/projects/6580544e90f945cd8d7b7f839542d17a/users/535a70e1530e49969a2df5963f860415/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:16.287657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.407410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb8570-901f-477e-bf06-e8dcb0fa2dde admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.410845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a01f2-24e2-4a40-a0a9-9cbf132c1675 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.418170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.419339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.419625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.419905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.421481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.422165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.422450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.422723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.424173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.425616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:16.425925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.428075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.430659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.454319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 977/1957] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:16.455781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.460877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 981/1958] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:16.462662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.484972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e104-50c5-4610-8644-2f8fe3ebf1f9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.489587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88259806-7b85-4753-9bf0-7cb539b5a10d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.492691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.493700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.494037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.494397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] PATH_INFO: `/v3/projects/697bcb75fd8b47708fbdc86886f23907/users/02bb326dbe6d405bb0133288c4b26498/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.497213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.497945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697bcb75fd8b47708fbdc86886f23907, user_id=02bb326dbe6d405bb0133288c4b26498, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.498156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.498529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.498904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.499695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.500847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.501871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.523674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 978/1959] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:16.526808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.528506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 982/1960] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:16 2022] PUT /identity/v3/projects/697bcb75fd8b47708fbdc86886f23907/users/02bb326dbe6d405bb0133288c4b26498/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:16.529561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.552081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530cead-0a80-49f4-8a7a-1dff56a9746d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.647006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb9ce3-4004-43ac-bb67-c828f1daf2e1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.653293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db08de-98af-47e1-a9ee-d36b3adfd7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.655001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db08de-98af-47e1-a9ee-d36b3adfd7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.655512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db08de-98af-47e1-a9ee-d36b3adfd7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.655973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db08de-98af-47e1-a9ee-d36b3adfd7e1 admin admin] PATH_INFO: `/v3/projects/6580544e90f945cd8d7b7f839542d17a/users/535a70e1530e49969a2df5963f860415/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.662151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db08de-98af-47e1-a9ee-d36b3adfd7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6580544e90f945cd8d7b7f839542d17a, user_id=535a70e1530e49969a2df5963f860415, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.665425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.666280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.666467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db08de-98af-47e1-a9ee-d36b3adfd7e1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.666924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.667383 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.668591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.670859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.684506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 983/1961] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:16 2022] PUT /identity/v3/projects/6580544e90f945cd8d7b7f839542d17a/users/535a70e1530e49969a2df5963f860415/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:16.691637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.691637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.691832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.729159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 979/1962] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:16 2022] POST /identity/v3/projects => generated 401 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:16.730080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.750034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] MFA Rules not processed for user `02bb326dbe6d405bb0133288c4b26498`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:16.752455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:16.829017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c6a5b-0b8f-450c-aece-3d3cb171691a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.848253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.848932 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.849216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.850150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.850269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.852228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.860793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:16.884639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:16.901284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 980/1963] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:16 2022] POST /identity/v3/users => generated 301 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:16.902348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.926509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d404560-7945-429b-9a9c-7d65aa9cc987 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:16.939577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:16.940686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:16.940971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:16.941252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:16.943436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:16.945602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:16.974746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 981/1964] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:16.979259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:16.998460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 984/1965] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:17.000124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.001811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:17.008661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d6d7-3b08-47b8-8886-1b0d6f244f14 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.021833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.023258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.023580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.023860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.024638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.026326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.063626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 982/1966] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:17.067525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.081230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faced4-c96a-4520-af5d-1b6ced007c8e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.087952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150d174-93cc-4e06-9eb7-12455ee82937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.088601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d174-93cc-4e06-9eb7-12455ee82937 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.088999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d174-93cc-4e06-9eb7-12455ee82937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.089281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150d174-93cc-4e06-9eb7-12455ee82937 admin admin] PATH_INFO: `/v3/projects/8d21e932709d415daeb1cc39c9dc6fa1/users/70dd689c1c934f57bacc1ca747d3bfbb/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.105356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb875f-cc70-4909-a374-1dd01e84ecaa None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.109151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150d174-93cc-4e06-9eb7-12455ee82937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21e932709d415daeb1cc39c9dc6fa1, user_id=70dd689c1c934f57bacc1ca747d3bfbb, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.111497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.112549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.113302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.113862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.117460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150d174-93cc-4e06-9eb7-12455ee82937 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.125726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.127785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.147625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 983/1967] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:17 2022] PUT /identity/v3/projects/8d21e932709d415daeb1cc39c9dc6fa1/users/70dd689c1c934f57bacc1ca747d3bfbb/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:17.147820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 985/1968] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:17.149619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4d1b-76ed-4888-b234-fa5ff1bc1140 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.150005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4d1b-76ed-4888-b234-fa5ff1bc1140 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.150278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4d1b-76ed-4888-b234-fa5ff1bc1140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.218417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4b7d4d1b-76ed-4888-b234-fa5ff1bc1140 None None] MFA Rules not processed for user `70dd689c1c934f57bacc1ca747d3bfbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:17.221355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4b7d4d1b-76ed-4888-b234-fa5ff1bc1140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:17.244877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.261468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd64e2-5f19-44b5-a35e-2d84b8bd0ccf service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.337145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 984/1969] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:17.340450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d4d1b-76ed-4888-b234-fa5ff1bc1140 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.357273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.358121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.358472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.358765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] PATH_INFO: `/v3/users/2bab642623504e15ad7bfe9404208eaf` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.360458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bab642623504e15ad7bfe9404208eaf)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.363558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.440834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bab642623504e15ad7bfe9404208eaf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:17.441743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bab642623504e15ad7bfe9404208eaf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:17.441904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d4d1b-76ed-4888-b234-fa5ff1bc1140 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.449085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.450328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.450763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.451052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.451806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bab642623504e15ad7bfe9404208eaf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:17.452304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.453362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bab642623504e15ad7bfe9404208eaf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:17.455741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.467658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0ced3f36-9ab4-4447-afdc-cf94a06cea14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bab642623504e15ad7bfe9404208eaf'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:17.477477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:17.505226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 986/1970] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:17 2022] DELETE /identity/v3/users/2bab642623504e15ad7bfe9404208eaf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:17.507897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.508350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.508960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.534013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:17.535665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:17.554512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 985/1971] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:17 2022] POST /identity/v3/projects => generated 401 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:17.565917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.573397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:17.653207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 987/1972] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:17.667542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.669266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:17.689620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:17.805578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a98fdf-f478-4889-8650-b5139d8aed3d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.811013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff18682-77c6-40f0-8fb0-58df90111ed8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.818058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.820183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.820550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.820837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.821814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.824199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.857407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 986/1973] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:17 2022] POST /identity/v3/users => generated 307 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:17.862367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.877194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204f67-4d15-4456-aadb-12d8e6f2b4bf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.883946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.884518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.884952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.885342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.886217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.888132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.903985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 987/1974] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:17.908498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.921480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd9818-26b2-4526-ac81-983d4b356cb0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:17.929737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.931215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.931599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.931976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] PATH_INFO: `/v3/projects/9140a012a7b0495bb42e0cad57228f00/users/0dc8bde5688a4b10a09e3b5d77a4790e/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.958544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9140a012a7b0495bb42e0cad57228f00, user_id=0dc8bde5688a4b10a09e3b5d77a4790e, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.972583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.972721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:17.972721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:17.972721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:17.972721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:17.977551 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:17.978504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:17.980735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 988/1975] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:17 2022] PUT /identity/v3/projects/9140a012a7b0495bb42e0cad57228f00/users/0dc8bde5688a4b10a09e3b5d77a4790e/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:17.984180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:17.995765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 988/1976] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:56:18.136952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d00a6-09d6-4559-99ff-1fa62532988b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:18.148146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd350eb8-67aa-486b-b764-c85bb9cbe1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:18.161278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd350eb8-67aa-486b-b764-c85bb9cbe1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:18.162159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd350eb8-67aa-486b-b764-c85bb9cbe1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:18.162450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd350eb8-67aa-486b-b764-c85bb9cbe1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:18.163182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd350eb8-67aa-486b-b764-c85bb9cbe1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:18.167495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd350eb8-67aa-486b-b764-c85bb9cbe1f5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:18.193994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:18.200849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 989/1977] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:18.205823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8dd87-cb4c-4f66-9cce-69ff4987aaf0 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:18.214396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:18.216726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:18.217586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:18.217943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] PATH_INFO: `/v3/projects/9140a012a7b0495bb42e0cad57228f00/users/0dc8bde5688a4b10a09e3b5d77a4790e/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:18.220866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9140a012a7b0495bb42e0cad57228f00, user_id=0dc8bde5688a4b10a09e3b5d77a4790e, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:18.223945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:18.252409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 989/1978] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:18 2022] PUT /identity/v3/projects/9140a012a7b0495bb42e0cad57228f00/users/0dc8bde5688a4b10a09e3b5d77a4790e/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:18.284265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ec4b4-bccf-4bf8-964a-920c943a3163 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:18.285344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ec4b4-bccf-4bf8-964a-920c943a3163 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:18.288023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ec4b4-bccf-4bf8-964a-920c943a3163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:18.353426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-644ec4b4-bccf-4bf8-964a-920c943a3163 None None] MFA Rules not processed for user `0dc8bde5688a4b10a09e3b5d77a4790e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:18.355050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-644ec4b4-bccf-4bf8-964a-920c943a3163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:18.519019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 990/1979] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:18 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:18.539417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:18.542000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:18.594368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:18.630602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120970bd-0ddd-4d50-a16d-cc7b464aedfd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:18.637077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:18.641052 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:18.641430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:18.641857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:18.669970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:18.671870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:18.704411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 990/1980] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:18 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:18.821214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416d10-bff8-41f6-a41f-a3e5e07fc08a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:18.821982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416d10-bff8-41f6-a41f-a3e5e07fc08a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:18.821982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0416d10-bff8-41f6-a41f-a3e5e07fc08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:18.832047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:18.856852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:18.866460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be023705-5d77-4323-a1ad-f9b960c0d60c service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:18.866702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d0416d10-bff8-41f6-a41f-a3e5e07fc08a None None] MFA Rules not processed for user `535a70e1530e49969a2df5963f860415`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:18.868132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d0416d10-bff8-41f6-a41f-a3e5e07fc08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:18.884753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:18.885639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:18.886087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:18.886516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:18.888231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:19.021759 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:19.026113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:19.048238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 991/1981] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:18 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:19.051018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:19.062357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 991/1982] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:19.065588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:19.065875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:19.066156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:19.070411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:19.109690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] MFA Rules not processed for user `d0ab0630297b45cc8eb09ef625810aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:19.110986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:19.240321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae233d32-9e2d-4a15-b307-893aa2c78a63 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:19.251110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:19.252729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:19.252895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:19.253334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] PATH_INFO: `/v3/projects/0eb80ca8bcdc455fbe68170a90a8ea4e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:19.255478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb80ca8bcdc455fbe68170a90a8ea4e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:19.259490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:19.278236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 992/1983] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:19.290957 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:19.292567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:19.358494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb80ca8bcdc455fbe68170a90a8ea4e', 'request_id': 'req-9cb423cf-1481-40e1-96fa-53ca076debf6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.369223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb80ca8bcdc455fbe68170a90a8ea4e', 'request_id': 'req-9cb423cf-1481-40e1-96fa-53ca076debf6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.378868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb80ca8bcdc455fbe68170a90a8ea4e', 'request_id': 'req-9cb423cf-1481-40e1-96fa-53ca076debf6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.395246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] The token cache is being invalidate because project 0eb80ca8bcdc455fbe68170a90a8ea4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:19.395777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.396946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.399854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 992/1984] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:19 2022] DELETE /identity/v3/projects/0eb80ca8bcdc455fbe68170a90a8ea4e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:19.403613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf41fe-ed11-4406-b9d6-a794d569caad None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:19.404591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:19.408016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:19.416012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:19.471846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:19.529737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:19.531044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:19.531829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:19.532263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:19.536045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:19.542009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb423cf-1481-40e1-96fa-53ca076debf6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:19.548499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:19.549390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:19.549875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:19.550371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] PATH_INFO: `/v3/users/02bb326dbe6d405bb0133288c4b26498` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:19.551845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bb326dbe6d405bb0133288c4b26498)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:19.555070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:19.619833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bb326dbe6d405bb0133288c4b26498'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.620836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bb326dbe6d405bb0133288c4b26498'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.625731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:19.627923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:19.638393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 993/1985] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:19.643792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bb326dbe6d405bb0133288c4b26498'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.645472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bb326dbe6d405bb0133288c4b26498'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.657015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e14f0f21-9370-4973-a150-594b18b3a671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bb326dbe6d405bb0133288c4b26498'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:19.682345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 993/1986] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:19 2022] DELETE /identity/v3/users/02bb326dbe6d405bb0133288c4b26498 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:20.211359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:20.223141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d385e21-64fa-4d7b-951d-d3673ac411e3 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:20.314296 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:20.314967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:20.315253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:20.315533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] PATH_INFO: `/v3/projects/697bcb75fd8b47708fbdc86886f23907` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:20.318779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697bcb75fd8b47708fbdc86886f23907)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:20.320773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:20.379256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697bcb75fd8b47708fbdc86886f23907', 'request_id': 'req-04367779-1b65-4c74-a2f0-71dce0f96fc4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:20.395316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697bcb75fd8b47708fbdc86886f23907', 'request_id': 'req-04367779-1b65-4c74-a2f0-71dce0f96fc4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:20.410248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697bcb75fd8b47708fbdc86886f23907', 'request_id': 'req-04367779-1b65-4c74-a2f0-71dce0f96fc4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:20.420174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:20.426171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] The token cache is being invalidate because project 697bcb75fd8b47708fbdc86886f23907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:20.426651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:20.427560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04367779-1b65-4c74-a2f0-71dce0f96fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:20.441610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 994/1987] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:20 2022] DELETE /identity/v3/projects/697bcb75fd8b47708fbdc86886f23907 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:20.446955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f873276-ca84-4e01-ac24-e789b5671e57 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:20.447274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f873276-ca84-4e01-ac24-e789b5671e57 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:20.447573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f873276-ca84-4e01-ac24-e789b5671e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:20.475124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7f873276-ca84-4e01-ac24-e789b5671e57 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:20.476372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7f873276-ca84-4e01-ac24-e789b5671e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:20.608598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 994/1988] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:20.618561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3a2f-40c3-43c7-b279-5995fe5fd138 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:20.618994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3a2f-40c3-43c7-b279-5995fe5fd138 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:20.619374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3a2f-40c3-43c7-b279-5995fe5fd138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:20.649050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9c2c3a2f-40c3-43c7-b279-5995fe5fd138 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:20.650579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9c2c3a2f-40c3-43c7-b279-5995fe5fd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:20.672670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 995/1989] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:20.672892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f873276-ca84-4e01-ac24-e789b5671e57 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:20.690203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f873276-ca84-4e01-ac24-e789b5671e57 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:20.695127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:20.696255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:20.697209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:20.697209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:20.697845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:20.698266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:20.700148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:20.714457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 995/1990] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:20.718499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c3a2f-40c3-43c7-b279-5995fe5fd138 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:20.729782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c3a2f-40c3-43c7-b279-5995fe5fd138 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:20.739958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:20.740827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:20.741836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:20.742419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:20.743169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:20.748046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:20.794923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 996/1991] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:20 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:20.799649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:20.815913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e5b9e-892e-4e82-991a-dd9777386917 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:20.843159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:20.929300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:20.929975 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:20.930262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:20.930610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:20.931262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:20.933426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:20.968464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 996/1992] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:20 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:20.989447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:21.003480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970e4a5-b20b-4a29-8f77-3fea53f3cd68 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:21.017400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:21.019680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:21.019978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:21.020258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:21.022882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:21.024584 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:21.049326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 997/1993] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:21.051728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:21.067552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d20c-da1a-4004-a748-b9439e026d43 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:21.080491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e4235-6658-4afc-ab63-76d9355ca0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:21.080491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4235-6658-4afc-ab63-76d9355ca0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:21.080491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4235-6658-4afc-ab63-76d9355ca0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:21.080491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e4235-6658-4afc-ab63-76d9355ca0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:21.081148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4235-6658-4afc-ab63-76d9355ca0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:21.081148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e4235-6658-4afc-ab63-76d9355ca0d3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:21.106407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 997/1994] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:21.110344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:21.123100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45e964-57de-4dc6-892a-5bfbc27912e6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:21.137899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:21.139023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:21.139521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:21.140007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] PATH_INFO: `/v3/projects/6aa1bdfc585744a6854db0e8df779034/users/14704cc6d65144949dc1519f42c3e678/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:21.164891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa1bdfc585744a6854db0e8df779034, user_id=14704cc6d65144949dc1519f42c3e678, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:21.168279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:21.199253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 998/1995] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:21 2022] PUT /identity/v3/projects/6aa1bdfc585744a6854db0e8df779034/users/14704cc6d65144949dc1519f42c3e678/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:21.201433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:21.201827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:21.202202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:21.242023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] MFA Rules not processed for user `14704cc6d65144949dc1519f42c3e678`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:21.246841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:21.359141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 998/1996] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:21.367053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:21.369611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:21.430482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceb555-a242-4dbb-bc82-c9b26a4d28fa admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:21.435845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452731a-68ea-4fe0-a91d-cf177368b23b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:21.436475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452731a-68ea-4fe0-a91d-cf177368b23b service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:21.436765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452731a-68ea-4fe0-a91d-cf177368b23b service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:21.437044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452731a-68ea-4fe0-a91d-cf177368b23b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:21.449432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452731a-68ea-4fe0-a91d-cf177368b23b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:21.451055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452731a-68ea-4fe0-a91d-cf177368b23b service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:21.462190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 999/1997] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:23.690149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:23.692831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:23.832373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3dae6-3cb6-455e-9982-e9e6508475b7 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:23.845479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:23.846279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:23.846559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:23.846828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] PATH_INFO: `/v3/users/70dd689c1c934f57bacc1ca747d3bfbb` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:23.849361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70dd689c1c934f57bacc1ca747d3bfbb)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:23.852498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:23.939220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:23.974762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70dd689c1c934f57bacc1ca747d3bfbb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:23.975477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70dd689c1c934f57bacc1ca747d3bfbb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:23.988570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70dd689c1c934f57bacc1ca747d3bfbb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:23.988570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70dd689c1c934f57bacc1ca747d3bfbb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:23.995742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70dd689c1c934f57bacc1ca747d3bfbb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:24.041067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 999/1998] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:23 2022] DELETE /identity/v3/users/70dd689c1c934f57bacc1ca747d3bfbb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:24.047237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:24.047766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:24.048105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:24.077315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:24.080193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:24.184514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1000/1999] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:24.187807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:24.189266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:24.312534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f76c5e-a679-42b5-b17e-0f4ae83e37c6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:24.317357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:24.318168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:24.318637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:24.318958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:24.338116 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:24.348279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:24.377632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1000/2000] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:25.156987 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:25.159100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:25.171257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90076dff-c627-4267-8ad7-99b35fe0112f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:25.176153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:25.176861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:25.177327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:25.177608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] PATH_INFO: `/v3/projects/8d21e932709d415daeb1cc39c9dc6fa1` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:25.178773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d21e932709d415daeb1cc39c9dc6fa1)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:25.181514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:25.219958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:25.230877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d21e932709d415daeb1cc39c9dc6fa1', 'request_id': 'req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.237051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d21e932709d415daeb1cc39c9dc6fa1', 'request_id': 'req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.244855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d21e932709d415daeb1cc39c9dc6fa1', 'request_id': 'req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.257736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] The token cache is being invalidate because project 8d21e932709d415daeb1cc39c9dc6fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:25.258029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.258699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.260204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1001/2001] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:25 2022] DELETE /identity/v3/projects/8d21e932709d415daeb1cc39c9dc6fa1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:25.264216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:25.275605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6ace7-11ad-42db-821d-cf1d19bc5c3c service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:25.332114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:25.333094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:25.333404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:25.333683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] PATH_INFO: `/v3/users/0dc8bde5688a4b10a09e3b5d77a4790e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:25.334819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc8bde5688a4b10a09e3b5d77a4790e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:25.336896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:25.383106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:25.386302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc8bde5688a4b10a09e3b5d77a4790e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.387058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc8bde5688a4b10a09e3b5d77a4790e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.397509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc8bde5688a4b10a09e3b5d77a4790e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.398219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc8bde5688a4b10a09e3b5d77a4790e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.405769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-99bc9dc6-7e17-4af4-af2e-746b650501ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc8bde5688a4b10a09e3b5d77a4790e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.423800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1001/2002] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:25 2022] DELETE /identity/v3/users/0dc8bde5688a4b10a09e3b5d77a4790e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:25.747849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:25.749472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:25.764301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0527e-0f04-4ad5-8f9b-d28df6093ce4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:25.830716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:25.831348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:25.831629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:25.831906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] PATH_INFO: `/v3/projects/9140a012a7b0495bb42e0cad57228f00` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:25.833039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9140a012a7b0495bb42e0cad57228f00)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:25.835236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:25.880671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9140a012a7b0495bb42e0cad57228f00', 'request_id': 'req-9231a125-cae8-4e46-b43f-d2a7a966247a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.886355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9140a012a7b0495bb42e0cad57228f00', 'request_id': 'req-9231a125-cae8-4e46-b43f-d2a7a966247a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.893942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9140a012a7b0495bb42e0cad57228f00', 'request_id': 'req-9231a125-cae8-4e46-b43f-d2a7a966247a'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.904757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] The token cache is being invalidate because project 9140a012a7b0495bb42e0cad57228f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:25.905049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.905686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9231a125-cae8-4e46-b43f-d2a7a966247a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:25.908781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1002/2003] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:25 2022] DELETE /identity/v3/projects/9140a012a7b0495bb42e0cad57228f00 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:25.912167 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ec7de-9ef8-4fff-8d18-c04bd80208d3 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:25.912658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ec7de-9ef8-4fff-8d18-c04bd80208d3 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:25.912897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ec7de-9ef8-4fff-8d18-c04bd80208d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:25.933654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-536ec7de-9ef8-4fff-8d18-c04bd80208d3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:25.934892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-536ec7de-9ef8-4fff-8d18-c04bd80208d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:26.004902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1002/2004] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:26.013512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749491e-69ef-4ba9-87f6-bd6cb489e21d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.014028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749491e-69ef-4ba9-87f6-bd6cb489e21d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.014513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749491e-69ef-4ba9-87f6-bd6cb489e21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.037823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b749491e-69ef-4ba9-87f6-bd6cb489e21d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:26.039139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b749491e-69ef-4ba9-87f6-bd6cb489e21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:26.049205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1003/2005] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:26.054082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ec7de-9ef8-4fff-8d18-c04bd80208d3 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.064849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ec7de-9ef8-4fff-8d18-c04bd80208d3 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.069559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.070172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.070460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.070734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.071390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:26.071696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.073458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.086292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1003/2006] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:26.090788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749491e-69ef-4ba9-87f6-bd6cb489e21d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.101031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749491e-69ef-4ba9-87f6-bd6cb489e21d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.108875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.109497 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.109783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.110082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.110885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.113299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.142379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1004/2007] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:26 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:26.146663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.156972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe90608-feec-4a5e-a4cc-2a43f010a8f4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.218787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.219430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.220399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.220720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.221366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.223437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.244897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1004/2008] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:26 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:26.249126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.260907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1235-3edd-4cb9-9fc7-653f7f80ed74 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.265498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.266102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.266386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.267217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.267865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.269531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.279315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1005/2009] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:26.283390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.293689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d2ebf-4141-474a-b877-539982f1f781 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.298927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593c40c-d68b-4367-8d55-0bc25b299217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.299570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c40c-d68b-4367-8d55-0bc25b299217 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.299855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c40c-d68b-4367-8d55-0bc25b299217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.300137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593c40c-d68b-4367-8d55-0bc25b299217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.300827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593c40c-d68b-4367-8d55-0bc25b299217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.302457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593c40c-d68b-4367-8d55-0bc25b299217 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.315428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1005/2010] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:26.319438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.329920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6c167-d7fb-467d-9f90-886fc99c3a3b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.334695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.335252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.335547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.335827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] PATH_INFO: `/v3/projects/865f2bd8f94a47cb803f9219705b9443/users/eed73c471de54c2690d973bd03483ba1/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.347648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:26.353637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=865f2bd8f94a47cb803f9219705b9443, user_id=eed73c471de54c2690d973bd03483ba1, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.356911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.370898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1006/2011] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:26 2022] PUT /identity/v3/projects/865f2bd8f94a47cb803f9219705b9443/users/eed73c471de54c2690d973bd03483ba1/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:26.381936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2b80-8c01-4fc3-af12-14303a975eb4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.382227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2b80-8c01-4fc3-af12-14303a975eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.382505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2b80-8c01-4fc3-af12-14303a975eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.412251 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ad6a2b80-8c01-4fc3-af12-14303a975eb4 None None] MFA Rules not processed for user `eed73c471de54c2690d973bd03483ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:26.413565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ad6a2b80-8c01-4fc3-af12-14303a975eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:26.426127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:26.479852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1006/2012] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:26.484338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.550806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096301c-3c75-43bc-86a4-93de9fdff3ed admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.555787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.556431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.556722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.557052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.557710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.559620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.601717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1007/2013] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:26 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:26.602878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a2b80-8c01-4fc3-af12-14303a975eb4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.635750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a2b80-8c01-4fc3-af12-14303a975eb4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.703194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.703814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.704139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.704457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.705107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.707209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.731424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1007/2014] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:26 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:26.736681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.761949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f90c1-4d06-43f9-9401-a9ba39e3923f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.769606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.770985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.771273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.773219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.774063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.777189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.794003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1008/2015] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:26.797293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.809508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2d1d7-0d90-46cc-8936-27f623d46051 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.817959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.819003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.819003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.819161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] PATH_INFO: `/v3/projects/d7d8803d20af41bea46eef1dedb36bf7/users/6cf2a3f305ef4c11b9ef6bd13388f06f/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.839672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d8803d20af41bea46eef1dedb36bf7, user_id=6cf2a3f305ef4c11b9ef6bd13388f06f, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.842735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.870413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:26.870894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1008/2016] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:26 2022] PUT /identity/v3/projects/d7d8803d20af41bea46eef1dedb36bf7/users/6cf2a3f305ef4c11b9ef6bd13388f06f/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:26.890978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4aeb-5eac-45ff-bc56-3066352d87a7 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:26.975128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2dec5-efda-4275-946b-3917222df1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:26.975744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2dec5-efda-4275-946b-3917222df1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:26.976090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2dec5-efda-4275-946b-3917222df1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:26.976465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2dec5-efda-4275-946b-3917222df1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:26.977182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2dec5-efda-4275-946b-3917222df1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:26.980314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2dec5-efda-4275-946b-3917222df1ad admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:26.989950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1009/2017] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:26.994168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:27.007393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9f9a6-3473-47cd-b044-f48f4f93c746 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:27.013932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:27.014375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:27.014670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:27.014949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] PATH_INFO: `/v3/projects/d7d8803d20af41bea46eef1dedb36bf7/users/6cf2a3f305ef4c11b9ef6bd13388f06f/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:27.017626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d8803d20af41bea46eef1dedb36bf7, user_id=6cf2a3f305ef4c11b9ef6bd13388f06f, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:27.021702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:27.036145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1009/2018] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:26 2022] PUT /identity/v3/projects/d7d8803d20af41bea46eef1dedb36bf7/users/6cf2a3f305ef4c11b9ef6bd13388f06f/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:27.048018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698de59-7f24-4acf-b0c9-b00e9bf716d9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:27.048472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698de59-7f24-4acf-b0c9-b00e9bf716d9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:27.049121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698de59-7f24-4acf-b0c9-b00e9bf716d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:27.082041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9698de59-7f24-4acf-b0c9-b00e9bf716d9 None None] MFA Rules not processed for user `6cf2a3f305ef4c11b9ef6bd13388f06f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:27.083723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9698de59-7f24-4acf-b0c9-b00e9bf716d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:27.180095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:27.228094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1010/2019] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:27.239071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:27.245982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:27.343228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ef963-67a5-4c57-abc7-5b9a6848154a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:27.349523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90a8bf-b480-48a6-aec4-7b66a771dc67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:27.350393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a8bf-b480-48a6-aec4-7b66a771dc67 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:27.350850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a8bf-b480-48a6-aec4-7b66a771dc67 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:27.351291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a8bf-b480-48a6-aec4-7b66a771dc67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:27.367275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90a8bf-b480-48a6-aec4-7b66a771dc67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:27.368774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90a8bf-b480-48a6-aec4-7b66a771dc67 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:27.379625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1010/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:56:27.535869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698de59-7f24-4acf-b0c9-b00e9bf716d9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:27.613242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698de59-7f24-4acf-b0c9-b00e9bf716d9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:27.626083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:27.627899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:27.628376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:27.628725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] PATH_INFO: `/v3/users/eed73c471de54c2690d973bd03483ba1` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:27.629994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed73c471de54c2690d973bd03483ba1)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:27.632026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:27.747580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed73c471de54c2690d973bd03483ba1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:27.748468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed73c471de54c2690d973bd03483ba1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:27.749616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed73c471de54c2690d973bd03483ba1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:27.758537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed73c471de54c2690d973bd03483ba1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:27.770551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed73c471de54c2690d973bd03483ba1'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:27.791372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1011/2021] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:27 2022] DELETE /identity/v3/users/eed73c471de54c2690d973bd03483ba1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:27.795944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:27.796320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:27.796643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:27.824307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:27.825729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:27.831332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:27.898359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1011/2022] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:27.911939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:27.913628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:28.024630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35207bab-e8be-4824-a855-aac81c715165 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:28.029244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:28.030442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:28.030947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:28.031552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:28.044058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:28.046695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:28.059190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1012/2023] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:28.401995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:28.404010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:28.425244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554f714-9804-4ae6-8408-31af4d6fcfc8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:28.438026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:28.439288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:28.439712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:28.440243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] PATH_INFO: `/v3/projects/865f2bd8f94a47cb803f9219705b9443` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:28.441692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=865f2bd8f94a47cb803f9219705b9443)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:28.443896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:28.524460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865f2bd8f94a47cb803f9219705b9443', 'request_id': 'req-1933c523-9e08-4bbc-a1bf-c2fca070f173'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.535359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865f2bd8f94a47cb803f9219705b9443', 'request_id': 'req-1933c523-9e08-4bbc-a1bf-c2fca070f173'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.542407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865f2bd8f94a47cb803f9219705b9443', 'request_id': 'req-1933c523-9e08-4bbc-a1bf-c2fca070f173'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.557438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] The token cache is being invalidate because project 865f2bd8f94a47cb803f9219705b9443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:28.557665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.558625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.560312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1012/2024] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:28 2022] DELETE /identity/v3/projects/865f2bd8f94a47cb803f9219705b9443 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:28.565174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:28.576197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b239ca-4d42-4831-9018-9965deb46bc1 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:28.584153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:28.653494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:28.654278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:28.654644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:28.654990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] PATH_INFO: `/v3/users/6cf2a3f305ef4c11b9ef6bd13388f06f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:28.656231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf2a3f305ef4c11b9ef6bd13388f06f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:28.658508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:28.725182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf2a3f305ef4c11b9ef6bd13388f06f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.725875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf2a3f305ef4c11b9ef6bd13388f06f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.726493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf2a3f305ef4c11b9ef6bd13388f06f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.736224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf2a3f305ef4c11b9ef6bd13388f06f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.748151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5ce70aee-d030-4ddb-a1d6-4b440edb2256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf2a3f305ef4c11b9ef6bd13388f06f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:28.775066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1013/2025] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:28 2022] DELETE /identity/v3/users/6cf2a3f305ef4c11b9ef6bd13388f06f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:29.082625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.084145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:29.097558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933c523-9e08-4bbc-a1bf-c2fca070f173 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.155020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.155649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.155928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.156201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] PATH_INFO: `/v3/projects/d7d8803d20af41bea46eef1dedb36bf7` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.157341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d8803d20af41bea46eef1dedb36bf7)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.159246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.196101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:29.206235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d8803d20af41bea46eef1dedb36bf7', 'request_id': 'req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:29.211937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d8803d20af41bea46eef1dedb36bf7', 'request_id': 'req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:29.218873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d8803d20af41bea46eef1dedb36bf7', 'request_id': 'req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:29.233532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] The token cache is being invalidate because project d7d8803d20af41bea46eef1dedb36bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:29.233826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:29.234488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4b4b1349-d3db-4c75-9f9c-1567a8b67e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:29.236520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1013/2026] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:29 2022] DELETE /identity/v3/projects/d7d8803d20af41bea46eef1dedb36bf7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:29.241689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1404-8950-4942-a381-55d4d1a78106 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.242053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1404-8950-4942-a381-55d4d1a78106 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.242335 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc1404-8950-4942-a381-55d4d1a78106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.261879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b1fc1404-8950-4942-a381-55d4d1a78106 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:29.263071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b1fc1404-8950-4942-a381-55d4d1a78106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:29.322891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1014/2027] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:29.330834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16a1d-f4b0-4970-ae2e-cc47bf2575a8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.331120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16a1d-f4b0-4970-ae2e-cc47bf2575a8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.331413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab16a1d-f4b0-4970-ae2e-cc47bf2575a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.353317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1ab16a1d-f4b0-4970-ae2e-cc47bf2575a8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:29.354559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ab16a1d-f4b0-4970-ae2e-cc47bf2575a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:29.363377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1014/2028] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:29.367826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc1404-8950-4942-a381-55d4d1a78106 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.378595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc1404-8950-4942-a381-55d4d1a78106 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.383621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.383949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.384237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.384553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.385213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:29.385526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.387259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.403462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1015/2029] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:29.404627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab16a1d-f4b0-4970-ae2e-cc47bf2575a8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.415754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab16a1d-f4b0-4970-ae2e-cc47bf2575a8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.422120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.422841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.423129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.423406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.424039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.426608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.463675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1015/2030] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:29 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:29.467814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.480453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f658c-2281-4792-bfbe-1e9f2ed22fce admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.493810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:29.550920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.551772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.552058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.552338 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.553008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.555362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.578143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1016/2031] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:29 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:29.582097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.594171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d10c2-41e6-43f7-93d2-76a1e4a8ae6f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.602400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.602878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.603456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.604212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.606376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.608465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.621475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1016/2032] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:29.629047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.639066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b67b0c-bf85-4578-a3b1-cbb772976b04 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.646004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665e03b-1507-44ff-b09d-5bc77ab8cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.646960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e03b-1507-44ff-b09d-5bc77ab8cec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.647410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e03b-1507-44ff-b09d-5bc77ab8cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.647695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665e03b-1507-44ff-b09d-5bc77ab8cec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.648732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665e03b-1507-44ff-b09d-5bc77ab8cec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.651316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665e03b-1507-44ff-b09d-5bc77ab8cec8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.669265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1017/2033] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:29.674072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.684521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116cbf5-ae77-4f98-b443-f2de47b838be admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.689817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.690474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.690753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.691027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] PATH_INFO: `/v3/projects/c41ac0f803b24d3e9676e10be5447771/users/3f45b4673b2d410e8b63c88a2eb25a42/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.706028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c41ac0f803b24d3e9676e10be5447771, user_id=3f45b4673b2d410e8b63c88a2eb25a42, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.708856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.731564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1017/2034] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:29 2022] PUT /identity/v3/projects/c41ac0f803b24d3e9676e10be5447771/users/3f45b4673b2d410e8b63c88a2eb25a42/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:29.744059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635d95-9100-428c-93e8-fb3378349b64 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.744324 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635d95-9100-428c-93e8-fb3378349b64 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.744629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8635d95-9100-428c-93e8-fb3378349b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.776052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a8635d95-9100-428c-93e8-fb3378349b64 None None] MFA Rules not processed for user `3f45b4673b2d410e8b63c88a2eb25a42`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:29.777320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a8635d95-9100-428c-93e8-fb3378349b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:29.848439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1018/2035] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:29.852983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.931321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492c3c-06d8-4797-b283-11c2af153723 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:29.936261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:29.936901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:29.937183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:29.937461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:29.938120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:29.940888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:29.970786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1018/2036] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:29 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:29.972018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635d95-9100-428c-93e8-fb3378349b64 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:29.983716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8635d95-9100-428c-93e8-fb3378349b64 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:30.046781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:30.048140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:30.048460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:30.048780 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:30.049562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:30.051876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:30.073675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1019/2037] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:29 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:30.077706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:30.088074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fdb4b-7e34-4e38-83d6-fc16b66240bb admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:30.093128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:30.093746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:30.094042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:30.094807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:30.095465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:30.097168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:30.118949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1019/2038] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:30.124732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:30.136947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72a7d4-2b71-44ea-b4ea-2ae010f9c515 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:30.141583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:30.142236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:30.142522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:30.142805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] PATH_INFO: `/v3/projects/643c627c489a4eaeaa329ccea5ad1dd2/users/46d3d0784e93498bbb3ca2e4865975e2/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:30.151164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:30.159730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=643c627c489a4eaeaa329ccea5ad1dd2, user_id=46d3d0784e93498bbb3ca2e4865975e2, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:30.162836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:30.175750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1020/2039] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:30 2022] PUT /identity/v3/projects/643c627c489a4eaeaa329ccea5ad1dd2/users/46d3d0784e93498bbb3ca2e4865975e2/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:30.180060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:30.190617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f304e9-ec5f-49e4-8a73-74dc6757ef18 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:30.222495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:30.249649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1170d-3006-4410-90d9-e1c3250713cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:30.250431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1170d-3006-4410-90d9-e1c3250713cf admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:30.251345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1170d-3006-4410-90d9-e1c3250713cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:30.251622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1170d-3006-4410-90d9-e1c3250713cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:30.252372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1170d-3006-4410-90d9-e1c3250713cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:30.254302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1170d-3006-4410-90d9-e1c3250713cf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:30.265319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1020/2040] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:30.270384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:30.280582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0db39a-e871-4a56-ba47-a2585890ef7f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:30.285120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:30.285766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:30.286045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:30.286314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] PATH_INFO: `/v3/projects/643c627c489a4eaeaa329ccea5ad1dd2/users/46d3d0784e93498bbb3ca2e4865975e2/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:30.288219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=643c627c489a4eaeaa329ccea5ad1dd2, user_id=46d3d0784e93498bbb3ca2e4865975e2, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:30.291932 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:30.306359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1021/2041] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:30 2022] PUT /identity/v3/projects/643c627c489a4eaeaa329ccea5ad1dd2/users/46d3d0784e93498bbb3ca2e4865975e2/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:30.318540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:30.318725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:30.318993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:30.348946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] MFA Rules not processed for user `46d3d0784e93498bbb3ca2e4865975e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:30.350213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:30.424564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1021/2042] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:30.441550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:30.445072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:30.509524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8e0e4-0e75-4116-9a88-720e258b3ee1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:30.513162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:30.513872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:30.514162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:30.514439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:30.589058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:30.590548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:30.600684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1022/2043] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:35.109434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:35.111413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:35.124491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f41405-c7e0-4d13-8b53-d7ddc3e85ddc None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:35.129658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17768909-4dfd-45e0-a7a0-2b5babe36707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:35.130491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768909-4dfd-45e0-a7a0-2b5babe36707 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:35.130778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768909-4dfd-45e0-a7a0-2b5babe36707 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:35.131054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17768909-4dfd-45e0-a7a0-2b5babe36707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:35.149869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17768909-4dfd-45e0-a7a0-2b5babe36707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:35.151407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17768909-4dfd-45e0-a7a0-2b5babe36707 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:35.165521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1022/2044] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:36.959710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:36.961340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:37.064085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9bcc7-6be8-4070-a99f-f263da360550 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:37.080042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:37.080042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:37.080042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:37.080042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] PATH_INFO: `/v3/users/14704cc6d65144949dc1519f42c3e678` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:37.080660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14704cc6d65144949dc1519f42c3e678)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:37.080660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:37.124461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:37.149475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14704cc6d65144949dc1519f42c3e678'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.150388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14704cc6d65144949dc1519f42c3e678'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.151677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14704cc6d65144949dc1519f42c3e678'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.160488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14704cc6d65144949dc1519f42c3e678'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.170632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14704cc6d65144949dc1519f42c3e678'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.206353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1023/2045] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:36 2022] DELETE /identity/v3/users/14704cc6d65144949dc1519f42c3e678 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:37.206800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceec2f-13d3-4a44-8896-536f494c02b7 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:37.207281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceec2f-13d3-4a44-8896-536f494c02b7 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:37.207488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceec2f-13d3-4a44-8896-536f494c02b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:37.233524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-71ceec2f-13d3-4a44-8896-536f494c02b7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:37.235566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-71ceec2f-13d3-4a44-8896-536f494c02b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:37.379845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1023/2046] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:37.392445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:37.392445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:37.476641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff551f2f-b57b-4224-a82b-074bee6b7236 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:37.480629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f904f-b620-4570-9899-77de8e4afc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:37.481257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f904f-b620-4570-9899-77de8e4afc1f service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:37.481539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f904f-b620-4570-9899-77de8e4afc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:37.481935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f904f-b620-4570-9899-77de8e4afc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:37.493330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f904f-b620-4570-9899-77de8e4afc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:37.494885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f904f-b620-4570-9899-77de8e4afc1f service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:37.505994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1024/2047] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:37.725819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2fead-ee55-4e5f-93ab-15e527a5c48d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:37.726515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2fead-ee55-4e5f-93ab-15e527a5c48d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:37.726796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2fead-ee55-4e5f-93ab-15e527a5c48d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:37.728970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1024/2048] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:56:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:56:37.739769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:37.739769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:37.740032 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:37.769740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:37.771085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:37.823987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2fead-ee55-4e5f-93ab-15e527a5c48d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:37.827091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ecd2fead-ee55-4e5f-93ab-15e527a5c48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:37.868270 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2fead-ee55-4e5f-93ab-15e527a5c48d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:37.874912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:37.876328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:37.876802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:37.877242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] PATH_INFO: `/v3/users/97d63b77d6914ab58f4b745d0a0e5470` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:37.878554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d63b77d6914ab58f4b745d0a0e5470)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:37.880672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:37.897827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1025/2049] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:56:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:37.898862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:37.900249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:37.921280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca6ddb-d08b-4dea-a45c-fbbc3e77899f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:37.930027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:37.930692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:37.930973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:37.931304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] PATH_INFO: `/v3/projects/6aa1bdfc585744a6854db0e8df779034` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:37.933226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa1bdfc585744a6854db0e8df779034)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:37.938487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:37.942505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:37.950882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d63b77d6914ab58f4b745d0a0e5470'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.951890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d63b77d6914ab58f4b745d0a0e5470'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.960113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d63b77d6914ab58f4b745d0a0e5470'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.961121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d63b77d6914ab58f4b745d0a0e5470'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.972557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d63b77d6914ab58f4b745d0a0e5470'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:37.991277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:37.996225 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1025/2050] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:37 2022] DELETE /identity/v3/users/97d63b77d6914ab58f4b745d0a0e5470 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:37.997245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:37.998895 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.004741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa1bdfc585744a6854db0e8df779034', 'request_id': 'req-21361678-0cb7-4e83-b999-1d6ec06dd309'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.011908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa1bdfc585744a6854db0e8df779034', 'request_id': 'req-21361678-0cb7-4e83-b999-1d6ec06dd309'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.022168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa1bdfc585744a6854db0e8df779034', 'request_id': 'req-21361678-0cb7-4e83-b999-1d6ec06dd309'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.036325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] The token cache is being invalidate because project 6aa1bdfc585744a6854db0e8df779034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:38.036678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.037422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21361678-0cb7-4e83-b999-1d6ec06dd309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.039201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1026/2051] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:37 2022] DELETE /identity/v3/projects/6aa1bdfc585744a6854db0e8df779034 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:38.046878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebfa25-04fa-4e45-b8a2-b9dbfbefe193 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.047712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebfa25-04fa-4e45-b8a2-b9dbfbefe193 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.048065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebfa25-04fa-4e45-b8a2-b9dbfbefe193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.080277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b9ebfa25-04fa-4e45-b8a2-b9dbfbefe193 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:38.082286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b9ebfa25-04fa-4e45-b8a2-b9dbfbefe193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.088423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0e57d-b96b-4b2c-a67b-185eef0adae7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.094711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1623c4-9eda-4896-b2f6-4baaae5b65dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.095389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1623c4-9eda-4896-b2f6-4baaae5b65dc service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.097129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1623c4-9eda-4896-b2f6-4baaae5b65dc service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.097413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1623c4-9eda-4896-b2f6-4baaae5b65dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.100097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e1623c4-9eda-4896-b2f6-4baaae5b65dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.116622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1623c4-9eda-4896-b2f6-4baaae5b65dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.121967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1623c4-9eda-4896-b2f6-4baaae5b65dc service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.139361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1026/2052] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:38.165057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1027/2053] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:38.172837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.173166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.173446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.206363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:38.207750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.223045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1027/2054] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:38.228059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebfa25-04fa-4e45-b8a2-b9dbfbefe193 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.240960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebfa25-04fa-4e45-b8a2-b9dbfbefe193 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.248268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.249024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.249313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.249654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.250322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:38.250636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.253076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.276575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.281041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.288810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1028/2055] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:38.293405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.301487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78006dc7-6309-4c60-a093-6fcf69d84beb None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.306722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90b331-f935-43d5-85b0-788028bca821 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.315377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.316033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.316707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.316987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] PATH_INFO: `/v3/projects/6b51437e5705454288ae58ad703f7330` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.318452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.318883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b51437e5705454288ae58ad703f7330)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.319970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.320467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.320921 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.321749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.321977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.323982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.357299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1029/2056] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:38.358343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.382900 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b51437e5705454288ae58ad703f7330', 'request_id': 'req-3bd31647-7e30-416d-97e0-5cb4c5165729'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.389991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b51437e5705454288ae58ad703f7330', 'request_id': 'req-3bd31647-7e30-416d-97e0-5cb4c5165729'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.397248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b51437e5705454288ae58ad703f7330', 'request_id': 'req-3bd31647-7e30-416d-97e0-5cb4c5165729'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.418805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] The token cache is being invalidate because project 6b51437e5705454288ae58ad703f7330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:38.419297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.420498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3bd31647-7e30-416d-97e0-5cb4c5165729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:38.424505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1028/2057] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:38 2022] DELETE /identity/v3/projects/6b51437e5705454288ae58ad703f7330 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:38.429999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93788880-1768-45a7-903c-5a8839f7a11e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.430458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93788880-1768-45a7-903c-5a8839f7a11e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.430817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93788880-1768-45a7-903c-5a8839f7a11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.438410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a62843-b385-4936-98b2-cc5bc45e7eab admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.463436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-93788880-1768-45a7-903c-5a8839f7a11e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:38.464868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-93788880-1768-45a7-903c-5a8839f7a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.492565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:38.504749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:38.526649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.527373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.527809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.527996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.528715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.530828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.557755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1029/2058] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:38.558362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6c2d-58c9-48ca-bf29-d5781f672b61 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.558654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6c2d-58c9-48ca-bf29-d5781f672b61 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.559203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6c2d-58c9-48ca-bf29-d5781f672b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.565993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1030/2059] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:38.571032 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.573605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.589053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1aaf6c2d-58c9-48ca-bf29-d5781f672b61 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:38.591560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1aaf6c2d-58c9-48ca-bf29-d5781f672b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.593001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e04c3-2451-46cb-998e-835980cd2ff2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.597883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.598637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.599014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.599359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.600129 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.601912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.602360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1030/2060] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:38.606730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6c2d-58c9-48ca-bf29-d5781f672b61 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.613975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1031/2061] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:38.619389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.620201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6c2d-58c9-48ca-bf29-d5781f672b61 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.626501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.627108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.627387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.627692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.628308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:38.628636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.630447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.632597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663be2e6-054a-4a39-9a93-9f56936dcf31 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.638607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.639336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.639700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.640071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.641145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.643157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.657270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1032/2062] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:38.660712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1031/2063] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:56:38.660849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.661619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.674513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6078616-aa8d-4848-a841-7c7463b69a0b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.675439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d639bc7-d0da-48ac-8087-956f70ad306e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.680555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.680709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b0d47-945c-4591-90fe-d6d561cf4e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.681382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b0d47-945c-4591-90fe-d6d561cf4e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.681660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b0d47-945c-4591-90fe-d6d561cf4e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.681934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b0d47-945c-4591-90fe-d6d561cf4e17 admin admin] PATH_INFO: `/v3/projects/c413788031e4458e90b72337b46fdf3f/users/5ed2a2188b904bde9406ad42b640037b/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.683189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.683468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.683822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.684376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.686306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.706233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b0d47-945c-4591-90fe-d6d561cf4e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c413788031e4458e90b72337b46fdf3f, user_id=5ed2a2188b904bde9406ad42b640037b, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.709712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b0d47-945c-4591-90fe-d6d561cf4e17 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.719782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1033/2064] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:38.724022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.729517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1032/2065] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:38 2022] PUT /identity/v3/projects/c413788031e4458e90b72337b46fdf3f/users/5ed2a2188b904bde9406ad42b640037b/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:38.734302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.734676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.735002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.756319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:38.757770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.792529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724764a3-a738-4399-a934-c34e5f88b8ef admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.821944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1033/2066] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:38.828593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.829963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:38.850787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.851390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.851677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.851949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.852656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.854555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.878301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1034/2067] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:38 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:38.892725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.904240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804a82-5fc1-4e9b-bab2-fb8286c819cc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.910850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.911336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e0b9f-94b3-46b5-ac19-bfeb419e73b1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.911482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.911825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.912603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.913268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.915130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.915677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.916274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.916590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.916869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.926120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1035/2068] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:38.929657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.930425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.931189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.943796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1034/2069] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:38.943976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8ca54-c2ed-47f4-89fa-4b3bce45f872 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.949742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a8a3-be08-41c3-b470-18c1850dac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.950367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a8a3-be08-41c3-b470-18c1850dac13 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.950747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a8a3-be08-41c3-b470-18c1850dac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.950901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a8a3-be08-41c3-b470-18c1850dac13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:38.951547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a8a3-be08-41c3-b470-18c1850dac13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:38.953706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a8a3-be08-41c3-b470-18c1850dac13 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:38.964874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1036/2070] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:38.969849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:38.979982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c038b-72ed-426a-9b62-5e0e114daf92 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:38.984979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:38.985651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:38.985982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:38.986190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] PATH_INFO: `/v3/projects/7e022559d4e54abfbca6f24afbb21edf/users/9f7471393bb5443c974ee984e20f3d6b/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:39.002916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e022559d4e54abfbca6f24afbb21edf, user_id=9f7471393bb5443c974ee984e20f3d6b, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:39.005700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:39.017740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:39.024421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1035/2071] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:38 2022] PUT /identity/v3/projects/7e022559d4e54abfbca6f24afbb21edf/users/9f7471393bb5443c974ee984e20f3d6b/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:39.034804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c14e0-19cf-459e-ab4d-a127deb195ec None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:39.035271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c14e0-19cf-459e-ab4d-a127deb195ec None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:39.035351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c14e0-19cf-459e-ab4d-a127deb195ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:39.049548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:39.074774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4d2c14e0-19cf-459e-ab4d-a127deb195ec None None] MFA Rules not processed for user `9f7471393bb5443c974ee984e20f3d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:39.075997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4d2c14e0-19cf-459e-ab4d-a127deb195ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:39.155276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1037/2072] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:39.166228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:39.168474 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:39.245883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23be79b-cefd-4e39-9cd2-b0a016c73afd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:39.252501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:39.253130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:39.253418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:39.253690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:39.262164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:39.263764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:39.273575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1036/2073] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:39.666715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214f216-244e-46aa-8390-c030205dd763 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:39.667012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214f216-244e-46aa-8390-c030205dd763 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:39.667294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214f216-244e-46aa-8390-c030205dd763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:39.714465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3214f216-244e-46aa-8390-c030205dd763 None None] MFA Rules not processed for user `5ed2a2188b904bde9406ad42b640037b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:39.715839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3214f216-244e-46aa-8390-c030205dd763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:39.814793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1038/2074] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:39.825841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:39.827237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:39.889388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18b986-8328-4059-a99b-136ec9947fdc service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:39.892960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:39.893557 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:39.893834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:39.894104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:39.902091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:39.903513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:39.912878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1037/2075] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:41.191838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214f216-244e-46aa-8390-c030205dd763 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:41.201405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214f216-244e-46aa-8390-c030205dd763 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:41.205482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7235f4-4942-48fe-9fbd-fe1a0dcc753c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:41.206066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7235f4-4942-48fe-9fbd-fe1a0dcc753c service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:41.206352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7235f4-4942-48fe-9fbd-fe1a0dcc753c service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:41.206625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7235f4-4942-48fe-9fbd-fe1a0dcc753c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:41.208369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2f7235f4-4942-48fe-9fbd-fe1a0dcc753c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:41.289490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7235f4-4942-48fe-9fbd-fe1a0dcc753c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:41.290933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7235f4-4942-48fe-9fbd-fe1a0dcc753c service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:41.301501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1039/2076] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:41.531616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:41.533102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:41.600059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3f670-030d-455f-a261-c4f429f032a7 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:41.604967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:41.605688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:41.606002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:41.606342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] PATH_INFO: `/v3/users/3f45b4673b2d410e8b63c88a2eb25a42` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:41.607537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f45b4673b2d410e8b63c88a2eb25a42)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:41.610377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:41.645602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:41.667274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f45b4673b2d410e8b63c88a2eb25a42'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:41.667955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f45b4673b2d410e8b63c88a2eb25a42'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:41.676722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f45b4673b2d410e8b63c88a2eb25a42'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:41.677406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f45b4673b2d410e8b63c88a2eb25a42'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:41.685204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f45b4673b2d410e8b63c88a2eb25a42'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:41.703811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1038/2077] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:41 2022] DELETE /identity/v3/users/3f45b4673b2d410e8b63c88a2eb25a42 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:41.708437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0a57-a43d-49fc-bbf5-9dfcabb4ea54 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:41.708732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0a57-a43d-49fc-bbf5-9dfcabb4ea54 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:41.709007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e0a57-a43d-49fc-bbf5-9dfcabb4ea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:41.729604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b87e0a57-a43d-49fc-bbf5-9dfcabb4ea54 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:41.730821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b87e0a57-a43d-49fc-bbf5-9dfcabb4ea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:41.741140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:41.793531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1040/2078] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:41.804145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:41.805788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:41.880468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49ea13-29e6-4a9b-87a8-be9544ebe8e2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:41.884355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:41.885174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:41.885541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:41.885886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:41.896353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:41.898065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:41.908869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1039/2079] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:42.350651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6ead-7c6e-4428-81e8-6f1e05eb76b8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:42.351210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6ead-7c6e-4428-81e8-6f1e05eb76b8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:42.351210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b6ead-7c6e-4428-81e8-6f1e05eb76b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:42.382333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3e1b6ead-7c6e-4428-81e8-6f1e05eb76b8 None None] MFA Rules not processed for user `5ed2a2188b904bde9406ad42b640037b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:42.383722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3e1b6ead-7c6e-4428-81e8-6f1e05eb76b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:42.435244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:42.436790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:42.459534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92febbbc-3805-4a1f-b1d4-0fda4770a051 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:42.475514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:42.476197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:42.476463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:42.476745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] PATH_INFO: `/v3/projects/c41ac0f803b24d3e9676e10be5447771` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:42.477890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c41ac0f803b24d3e9676e10be5447771)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:42.487961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1041/2080] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:42.488151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:42.544954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c41ac0f803b24d3e9676e10be5447771', 'request_id': 'req-e882a929-1c72-475e-b66c-626dcdd912d8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.551173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c41ac0f803b24d3e9676e10be5447771', 'request_id': 'req-e882a929-1c72-475e-b66c-626dcdd912d8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.557763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c41ac0f803b24d3e9676e10be5447771', 'request_id': 'req-e882a929-1c72-475e-b66c-626dcdd912d8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.571160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] The token cache is being invalidate because project c41ac0f803b24d3e9676e10be5447771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:42.571433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.572067 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.573707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1040/2081] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:42 2022] DELETE /identity/v3/projects/c41ac0f803b24d3e9676e10be5447771 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:42.580885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6ead-7c6e-4428-81e8-6f1e05eb76b8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:42.599495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b6ead-7c6e-4428-81e8-6f1e05eb76b8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:42.684221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:42.685149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:42.685570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:42.685983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] PATH_INFO: `/v3/users/46d3d0784e93498bbb3ca2e4865975e2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:42.687250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d3d0784e93498bbb3ca2e4865975e2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:42.689940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:42.756877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d3d0784e93498bbb3ca2e4865975e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.757677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d3d0784e93498bbb3ca2e4865975e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.758421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d3d0784e93498bbb3ca2e4865975e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.770447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d3d0784e93498bbb3ca2e4865975e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.778549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-535974eb-a61a-4e3e-b83d-68fb2106c6a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d3d0784e93498bbb3ca2e4865975e2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:42.779856 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:42.800937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1042/2082] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:42 2022] DELETE /identity/v3/users/46d3d0784e93498bbb3ca2e4865975e2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:43.249217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:43.250797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:43.299099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882a929-1c72-475e-b66c-626dcdd912d8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:43.348864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:43.390159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:43.390867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:43.391144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:43.391500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] PATH_INFO: `/v3/projects/643c627c489a4eaeaa329ccea5ad1dd2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:43.396370 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=643c627c489a4eaeaa329ccea5ad1dd2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:43.398406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:43.458647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643c627c489a4eaeaa329ccea5ad1dd2', 'request_id': 'req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:43.464426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643c627c489a4eaeaa329ccea5ad1dd2', 'request_id': 'req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:43.470782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643c627c489a4eaeaa329ccea5ad1dd2', 'request_id': 'req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:43.486353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] The token cache is being invalidate because project 643c627c489a4eaeaa329ccea5ad1dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:43.486524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:43.487457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-04a486c4-1ae4-4819-a8fb-af5378c0ff0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:43.488970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1041/2083] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:43 2022] DELETE /identity/v3/projects/643c627c489a4eaeaa329ccea5ad1dd2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:43.495255 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc038-00f2-4390-8769-029f9dfc774e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:43.495724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc038-00f2-4390-8769-029f9dfc774e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:43.495855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9dc038-00f2-4390-8769-029f9dfc774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:43.518494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1c9dc038-00f2-4390-8769-029f9dfc774e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:43.519706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1c9dc038-00f2-4390-8769-029f9dfc774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:43.585401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1043/2084] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:43.594856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b18be-209e-41d2-bf3c-02704744a6d5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:43.595393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b18be-209e-41d2-bf3c-02704744a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:43.595393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b18be-209e-41d2-bf3c-02704744a6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:43.619992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c63b18be-209e-41d2-bf3c-02704744a6d5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:43.621221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c63b18be-209e-41d2-bf3c-02704744a6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:43.629656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1042/2085] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:43.635868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dc038-00f2-4390-8769-029f9dfc774e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:43.646285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9dc038-00f2-4390-8769-029f9dfc774e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:43.651990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:43.652846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:43.653271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:43.653685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:43.654643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:43.655091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:43.657550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:43.685138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1044/2086] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:56:43.686386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b18be-209e-41d2-bf3c-02704744a6d5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:43.698578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b18be-209e-41d2-bf3c-02704744a6d5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:43.705970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:43.707190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:43.707725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:43.708661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:43.709679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:43.712442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:43.753794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1043/2087] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:43 2022] POST /identity/v3/projects => generated 359 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:43.759343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:43.784093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d3a7a-835c-493a-a3c8-836918ec2681 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:43.883614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:43.884234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:43.884549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:43.884823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:43.886095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:43.887567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:43.915632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1045/2088] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:43 2022] POST /identity/v3/users => generated 280 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:43.917517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:43.937380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1232cc-b5a7-4cc9-aa93-b78b0b8b7dbd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:43.962066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:43.962757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:43.963104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:43.963455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:43.964165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:43.965948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:43.977814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1044/2089] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:43.982560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:43.993863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041647d-7003-4e70-846c-eae762fc42f3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:43.998902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc1f80-5a74-4d3b-aa0a-58a00d6931df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:43.999513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc1f80-5a74-4d3b-aa0a-58a00d6931df admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:44.000462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc1f80-5a74-4d3b-aa0a-58a00d6931df admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:44.000739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc1f80-5a74-4d3b-aa0a-58a00d6931df admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:44.001399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc1f80-5a74-4d3b-aa0a-58a00d6931df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:44.002991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc1f80-5a74-4d3b-aa0a-58a00d6931df admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:44.018244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1046/2090] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:44.023285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:44.034322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3affb-234c-4818-9df9-4eb3feedaf07 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:44.039472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:44.040178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:44.040498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:44.040783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] PATH_INFO: `/v3/projects/88576d80eb364aa69b797426b31aaf5e/users/38ecf30fa85449c6b3126421fb3a36d5/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:44.061974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88576d80eb364aa69b797426b31aaf5e, user_id=38ecf30fa85449c6b3126421fb3a36d5, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:44.065746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:44.084992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1045/2091] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:44 2022] PUT /identity/v3/projects/88576d80eb364aa69b797426b31aaf5e/users/38ecf30fa85449c6b3126421fb3a36d5/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:44.098674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdeace-ed83-4c2c-8bdb-081397751c0f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:44.099051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdeace-ed83-4c2c-8bdb-081397751c0f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:44.099403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdeace-ed83-4c2c-8bdb-081397751c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:44.130891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-26cdeace-ed83-4c2c-8bdb-081397751c0f None None] MFA Rules not processed for user `38ecf30fa85449c6b3126421fb3a36d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:44.132261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-26cdeace-ed83-4c2c-8bdb-081397751c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:44.167446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:44.202111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1047/2092] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:44.235872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:44.237912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:44.303020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a0a46-b199-4ae9-bf92-5c7eb1de164e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:44.304686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6381036-103c-4bbd-9782-36370d4be2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:44.305302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381036-103c-4bbd-9782-36370d4be2fc service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:44.305583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381036-103c-4bbd-9782-36370d4be2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:44.305856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381036-103c-4bbd-9782-36370d4be2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:44.316007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6381036-103c-4bbd-9782-36370d4be2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:44.317615 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6381036-103c-4bbd-9782-36370d4be2fc service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:44.322875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:44.329596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1046/2093] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:44.356587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdeace-ed83-4c2c-8bdb-081397751c0f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:44.410399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdeace-ed83-4c2c-8bdb-081397751c0f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:44.415101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:44.415733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:44.416015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:44.416290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] PATH_INFO: `/v3/users/38ecf30fa85449c6b3126421fb3a36d5` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:44.417476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ecf30fa85449c6b3126421fb3a36d5)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:44.419386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:44.482895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ecf30fa85449c6b3126421fb3a36d5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:44.483706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ecf30fa85449c6b3126421fb3a36d5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:44.484269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ecf30fa85449c6b3126421fb3a36d5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:44.491796 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ecf30fa85449c6b3126421fb3a36d5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:44.503258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ecf30fa85449c6b3126421fb3a36d5'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:44.535764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1048/2094] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:44 2022] DELETE /identity/v3/users/38ecf30fa85449c6b3126421fb3a36d5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:44.541354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:44.542222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:44.542222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:44.563095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:44.564673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:44.675908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1047/2095] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:44.682906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:44.689399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:44.750781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b83bd-cc3d-43ee-9cb3-dc83439f10ab admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:44.754594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a9308-0585-42ba-bc2c-044f9b3a0cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:44.755297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a9308-0585-42ba-bc2c-044f9b3a0cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:44.755582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a9308-0585-42ba-bc2c-044f9b3a0cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:44.755862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a9308-0585-42ba-bc2c-044f9b3a0cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:44.774863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a9308-0585-42ba-bc2c-044f9b3a0cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:44.776353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a9308-0585-42ba-bc2c-044f9b3a0cd2 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:44.781521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:44.790599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1049/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:45.111322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.113310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.132714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5ed63-927f-4d7d-be66-b73a53e40434 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.138045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.138803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.141536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.142012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] PATH_INFO: `/v3/projects/88576d80eb364aa69b797426b31aaf5e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.143282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88576d80eb364aa69b797426b31aaf5e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.145303 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.245746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88576d80eb364aa69b797426b31aaf5e', 'request_id': 'req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.253084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88576d80eb364aa69b797426b31aaf5e', 'request_id': 'req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.262628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88576d80eb364aa69b797426b31aaf5e', 'request_id': 'req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.284079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] The token cache is being invalidate because project 88576d80eb364aa69b797426b31aaf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:45.284375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.285806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.287391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1048/2097] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:45 2022] DELETE /identity/v3/projects/88576d80eb364aa69b797426b31aaf5e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:45.292495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec720f-9fd9-474c-8a26-205b4e3e743c None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.292783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec720f-9fd9-474c-8a26-205b4e3e743c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.293047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec720f-9fd9-474c-8a26-205b4e3e743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.314566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-33ec720f-9fd9-474c-8a26-205b4e3e743c None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:45.315629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-33ec720f-9fd9-474c-8a26-205b4e3e743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.388230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.389750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.411579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1050/2098] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:45.420600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65b76-c424-456d-a9ad-05790007ca23 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.420890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65b76-c424-456d-a9ad-05790007ca23 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.421166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f65b76-c424-456d-a9ad-05790007ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.442953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d0f65b76-c424-456d-a9ad-05790007ca23 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:45.444337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d0f65b76-c424-456d-a9ad-05790007ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.454047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1051/2099] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:45.458176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65b76-c424-456d-a9ad-05790007ca23 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.467784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f65b76-c424-456d-a9ad-05790007ca23 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.473351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.473959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.474240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.474512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.475160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:45.475463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.475655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dca6e-c12e-41a4-ba1a-da5de4c0d91e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.477117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.492431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1052/2100] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:56:45.497480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.499102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.499939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.500223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.500847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] PATH_INFO: `/v3/users/fb09f34c5d104cab999a4cd6ec003449` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.502671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb09f34c5d104cab999a4cd6ec003449)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.505259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.517969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc939da-8d8b-43e7-bb49-97cb3d51816a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.525770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.526985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.527455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.527825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.529079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.531182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.551318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:45.571597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1053/2101] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:45 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:45.575512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.581111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb09f34c5d104cab999a4cd6ec003449'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.581932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb09f34c5d104cab999a4cd6ec003449'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.590678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb09f34c5d104cab999a4cd6ec003449'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.591508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb09f34c5d104cab999a4cd6ec003449'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.602136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e5321234-812a-4afb-a3eb-38097113ac9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb09f34c5d104cab999a4cd6ec003449'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:45.625783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1049/2102] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:45 2022] DELETE /identity/v3/users/fb09f34c5d104cab999a4cd6ec003449 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:45.637422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.637722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.637982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.660029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:45.661310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.665117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012493ad-4fac-47c9-9aa8-b0221ba518c2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.743496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1050/2103] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:45.754686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.758598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.800821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.801687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.802173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.802753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.803611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.805793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.819674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:45.833661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1054/2104] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:45 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:45.837772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.839725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.858976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c51c4-63d1-4f0f-8e9b-0658ce86714a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.860740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e689d-fb78-4c83-9961-ac9cca466d85 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.864768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.865580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.865820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.866050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.866427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.866519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.866879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.867152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.867440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.869434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.882513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.884448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1055/2105] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:45.884696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.886333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.901427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f951b0-ac7e-458e-acec-3b1ab5b571a1 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.902411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1051/2106] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:56:45.903417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.905013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:45.908764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.909755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.910193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.910617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.919056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a2c3-9f64-4482-9a75-0793625a20a8 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.923531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.924716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.925434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.925776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.925983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.926155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] PATH_INFO: `/v3/users/9f7471393bb5443c974ee984e20f3d6b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.927379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7471393bb5443c974ee984e20f3d6b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:45.929481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:45.954814 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1056/2107] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:45.956086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:45.971162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b48d-e6de-405f-9b6c-54264a16e1fe admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:45.977746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923f2df-9e79-476d-ac49-00a8b357c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:45.978734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923f2df-9e79-476d-ac49-00a8b357c578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:45.978920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923f2df-9e79-476d-ac49-00a8b357c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:45.979311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923f2df-9e79-476d-ac49-00a8b357c578 admin admin] PATH_INFO: `/v3/projects/26abf5c9f7b04b49ad3d5078532f487e/users/647fd6ae77704d5e8dd59951621b990e/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:45.995590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:46.004968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923f2df-9e79-476d-ac49-00a8b357c578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26abf5c9f7b04b49ad3d5078532f487e, user_id=647fd6ae77704d5e8dd59951621b990e, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.006508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7471393bb5443c974ee984e20f3d6b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.007880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7471393bb5443c974ee984e20f3d6b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.008547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923f2df-9e79-476d-ac49-00a8b357c578 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.020573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7471393bb5443c974ee984e20f3d6b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.021968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7471393bb5443c974ee984e20f3d6b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.029060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1057/2108] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:45 2022] PUT /identity/v3/projects/26abf5c9f7b04b49ad3d5078532f487e/users/647fd6ae77704d5e8dd59951621b990e/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:46.036198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-06e32b1f-c1ad-4fac-b700-3f33f1544d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7471393bb5443c974ee984e20f3d6b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.040582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.041226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.041531 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.082985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1052/2109] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:45 2022] DELETE /identity/v3/users/9f7471393bb5443c974ee984e20f3d6b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:46.084903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] MFA Rules not processed for user `647fd6ae77704d5e8dd59951621b990e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:46.086297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.097282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.097752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.098206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.135231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:46.136810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.206214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1058/2110] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:46.211057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.213373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.215588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1053/2111] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:46.241750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.243283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.247362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721d071-ea56-49dd-adc3-4b07623976b4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.264120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.265912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.267042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.267470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.268528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.271439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.315436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1059/2112] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:46 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:46.319062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.330955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b5690-27b5-4577-be06-811704c7a4d6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.419421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8f838-dfa0-4be0-b4a6-b9a617e6cef4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.426735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.428023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.429400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.429819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.430738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.432961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.472362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1060/2113] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:46 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:46.473271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.475228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.482191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.482878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.483242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.483499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.487806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:46.493262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68281f-afa6-40ba-8d04-05e4f8ea8cec admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.497148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.499681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.501849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.502638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.503126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.503482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] PATH_INFO: `/v3/projects/3f74ea386aa540bab05cff85104282c0` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.504841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f74ea386aa540bab05cff85104282c0)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.506964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.513143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1054/2114] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:46.514802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.528275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13457b53-3f27-445d-8da3-513433b5a586 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.537586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.538906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.539257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.540823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.541585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.543432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.570823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1055/2115] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:46.585521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.594697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f74ea386aa540bab05cff85104282c0', 'request_id': 'req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.606854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f74ea386aa540bab05cff85104282c0', 'request_id': 'req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.616945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c230f-9709-4a04-975e-f32f14cf9b5d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.620811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f74ea386aa540bab05cff85104282c0', 'request_id': 'req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.629651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:46.646294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] The token cache is being invalidate because project 3f74ea386aa540bab05cff85104282c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:46.646592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.647348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7f04fe1e-7bd1-4f1f-8056-2fd384320bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:46.649131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1061/2116] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:46 2022] DELETE /identity/v3/projects/3f74ea386aa540bab05cff85104282c0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:46.658329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c866-3338-462b-816a-20e723f591de None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.658458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c866-3338-462b-816a-20e723f591de None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.658776 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c866-3338-462b-816a-20e723f591de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.707020 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ca23c866-3338-462b-816a-20e723f591de None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:46.708372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ca23c866-3338-462b-816a-20e723f591de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.795443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.796172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.799360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.799682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] PATH_INFO: `/v3/projects/fbe6f88adbc843a09980a1ec696777c2/users/98becb6b571e4bcbaee2aa851428d840/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.810912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1062/2117] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:46.818953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe6f88adbc843a09980a1ec696777c2, user_id=98becb6b571e4bcbaee2aa851428d840, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.819241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08c12f-9048-4192-83b3-77e23e6c2e5f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.820128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08c12f-9048-4192-83b3-77e23e6c2e5f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.820572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08c12f-9048-4192-83b3-77e23e6c2e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.821796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.842974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1056/2118] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:46 2022] PUT /identity/v3/projects/fbe6f88adbc843a09980a1ec696777c2/users/98becb6b571e4bcbaee2aa851428d840/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:46.847585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.849346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-dd08c12f-9048-4192-83b3-77e23e6c2e5f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:46.850586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.850798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dd08c12f-9048-4192-83b3-77e23e6c2e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:46.944045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1063/2119] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:46.948476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08c12f-9048-4192-83b3-77e23e6c2e5f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.961249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08c12f-9048-4192-83b3-77e23e6c2e5f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.968060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafd6d5-04be-4eb9-9203-29f09a8db38a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:46.971125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.971809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.972096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.972427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.973144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:46.973563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.975295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.975694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:46.976812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:46.977106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:46.977389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:46.978119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:46.980532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:46.996457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1064/2120] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:56:46.996457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:46.996457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.010352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1057/2121] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:47.011256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.014523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e919db-3b31-4d96-ae79-9a439bd6eef9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.025104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.025298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930991-f187-4ad7-b977-47580c21d851 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.025762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.026151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.026500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] PATH_INFO: `/v3/projects/7e022559d4e54abfbca6f24afbb21edf` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.027781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e022559d4e54abfbca6f24afbb21edf)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.029793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.030372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.030967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.031274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.031645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.032632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.034531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.043477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:47.082756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1058/2122] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:47.084134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.088549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e022559d4e54abfbca6f24afbb21edf', 'request_id': 'req-a5425804-dda4-4c7c-b7d8-4d624479e61e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:47.094472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e022559d4e54abfbca6f24afbb21edf', 'request_id': 'req-a5425804-dda4-4c7c-b7d8-4d624479e61e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:47.102339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e022559d4e54abfbca6f24afbb21edf', 'request_id': 'req-a5425804-dda4-4c7c-b7d8-4d624479e61e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:47.118145 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] The token cache is being invalidate because project 7e022559d4e54abfbca6f24afbb21edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:47.118444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:47.119364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:47.121192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1065/2123] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:46 2022] DELETE /identity/v3/projects/7e022559d4e54abfbca6f24afbb21edf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:47.122753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.126131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.166017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6c95-72a7-4910-ab2c-77fdd31cd98a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.171775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea620694-d5b2-446b-a526-b21442450c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.172565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620694-d5b2-446b-a526-b21442450c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.172909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620694-d5b2-446b-a526-b21442450c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.173246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620694-d5b2-446b-a526-b21442450c5a admin admin] PATH_INFO: `/v3/projects/fbe6f88adbc843a09980a1ec696777c2/users/98becb6b571e4bcbaee2aa851428d840/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.175542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea620694-d5b2-446b-a526-b21442450c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe6f88adbc843a09980a1ec696777c2, user_id=98becb6b571e4bcbaee2aa851428d840, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.178314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea620694-d5b2-446b-a526-b21442450c5a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.184565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:47.192772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1059/2124] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:47 2022] PUT /identity/v3/projects/fbe6f88adbc843a09980a1ec696777c2/users/98becb6b571e4bcbaee2aa851428d840/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:47.204885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425804-dda4-4c7c-b7d8-4d624479e61e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.205125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109d12c-eafb-4d36-ab2f-1e0e3dc0e67a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.205247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109d12c-eafb-4d36-ab2f-1e0e3dc0e67a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.206460 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109d12c-eafb-4d36-ab2f-1e0e3dc0e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.233278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6109d12c-eafb-4d36-ab2f-1e0e3dc0e67a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:47.235567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6109d12c-eafb-4d36-ab2f-1e0e3dc0e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.273558 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fac69-55f1-49e0-be96-028383a819f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.274569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fac69-55f1-49e0-be96-028383a819f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.274687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fac69-55f1-49e0-be96-028383a819f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.274907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fac69-55f1-49e0-be96-028383a819f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.275596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fac69-55f1-49e0-be96-028383a819f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.278090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fac69-55f1-49e0-be96-028383a819f7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.305099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1066/2125] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:47.306624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb947788-4c29-47a1-bddf-d0bf079fcac3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.306917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb947788-4c29-47a1-bddf-d0bf079fcac3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.307204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb947788-4c29-47a1-bddf-d0bf079fcac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.311302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1060/2126] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:47.312703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109d12c-eafb-4d36-ab2f-1e0e3dc0e67a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.334315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109d12c-eafb-4d36-ab2f-1e0e3dc0e67a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.343107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c8f21-2125-4f55-abea-9319c74ff4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.344521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8f21-2125-4f55-abea-9319c74ff4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.344521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8f21-2125-4f55-abea-9319c74ff4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.344887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c8f21-2125-4f55-abea-9319c74ff4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.345697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8f21-2125-4f55-abea-9319c74ff4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.347337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c8f21-2125-4f55-abea-9319c74ff4c4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.347828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bb947788-4c29-47a1-bddf-d0bf079fcac3 None None] MFA Rules not processed for user `98becb6b571e4bcbaee2aa851428d840`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:47.349529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bb947788-4c29-47a1-bddf-d0bf079fcac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.360327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1061/2127] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:47.362234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8570-fb94-4058-9f96-71952b30f41f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.362528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8570-fb94-4058-9f96-71952b30f41f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.362800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e8570-fb94-4058-9f96-71952b30f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.384072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:47.387475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a43e8570-fb94-4058-9f96-71952b30f41f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:47.389561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a43e8570-fb94-4058-9f96-71952b30f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.400089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1062/2128] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:47.404570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e8570-fb94-4058-9f96-71952b30f41f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.415609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e8570-fb94-4058-9f96-71952b30f41f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.420657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.421435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.421785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.422064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.422709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.424331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.434898 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1063/2129] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:47.439478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.449179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c4484-4276-4f76-961e-7560b4c9e496 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.452913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1067/2130] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:47.453963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb947788-4c29-47a1-bddf-d0bf079fcac3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.458437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.459236 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.461213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.461213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.461688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:47.461999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.463634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.469724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb947788-4c29-47a1-bddf-d0bf079fcac3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.474569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.475350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.475749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.476311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] PATH_INFO: `/v3/projects/5c00c93d716740038826ae3647061ffa/users/829f3b906dfc42d584517c630e055d72/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.481025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1064/2131] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:47.481025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.485296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.494682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c00c93d716740038826ae3647061ffa, user_id=829f3b906dfc42d584517c630e055d72, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.497759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.511421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1068/2132] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:47 2022] PUT /identity/v3/projects/5c00c93d716740038826ae3647061ffa/users/829f3b906dfc42d584517c630e055d72/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:47.517264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.546563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c017-bc49-4ea2-a80c-e0ae8d11cc3f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.591079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9d5e9-ca7c-41b7-821a-cf4904c654b5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.597031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506239-968d-4846-88f5-8c81624d53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.597858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506239-968d-4846-88f5-8c81624d53a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.598272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506239-968d-4846-88f5-8c81624d53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.598680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506239-968d-4846-88f5-8c81624d53a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.599470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506239-968d-4846-88f5-8c81624d53a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.601596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506239-968d-4846-88f5-8c81624d53a4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.602548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.603235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.603592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.604114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.606053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.632973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1069/2133] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:47.634472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.634760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.635413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.639749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:47.666505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] MFA Rules not processed for user `829f3b906dfc42d584517c630e055d72`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:47.667774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.678583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.680150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.695190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1065/2134] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:47.696671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.712699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf0159-50b9-460a-a849-a12f51851956 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.767216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1070/2135] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:47.800809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.802310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.802774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:47.802939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.803228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.803506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.804143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.806366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.824070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:47.838480 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1066/2136] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:47 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:47.839401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.850876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4976a2b-618d-42f6-81af-ae7e13c58f72 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.858237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.859552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.859836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.860111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.860855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.863354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.877973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1067/2137] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:47.880332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.892818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ae95b-9d19-46c7-b93c-d0be2c7a7150 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.897709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9441-bf0d-4ac7-87d2-3596780abde4 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.901492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93200a-559e-488a-a45f-d7a52c9bcc0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.901636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.902112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93200a-559e-488a-a45f-d7a52c9bcc0e service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.902397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93200a-559e-488a-a45f-d7a52c9bcc0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.902659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.902757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93200a-559e-488a-a45f-d7a52c9bcc0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.902949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.903221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.903865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.905872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.914417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93200a-559e-488a-a45f-d7a52c9bcc0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.916185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93200a-559e-488a-a45f-d7a52c9bcc0e service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:47.918470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1068/2138] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:47.924224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:47.931773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1071/2139] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:56:47.938155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff855054-84c4-4c65-b994-1260354ba293 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:47.944646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:47.945422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:47.945710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:47.946042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] PATH_INFO: `/v3/projects/c24fb5c6dcd044dd83604b05ee70ff10/users/b836e06514734acd93d7d04eb71d05f0/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:47.990654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24fb5c6dcd044dd83604b05ee70ff10, user_id=b836e06514734acd93d7d04eb71d05f0, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:47.997491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:48.019588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1069/2140] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:47 2022] PUT /identity/v3/projects/c24fb5c6dcd044dd83604b05ee70ff10/users/b836e06514734acd93d7d04eb71d05f0/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:48.031605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae230b-bc09-415e-82de-4340b970c9f6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:48.033121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae230b-bc09-415e-82de-4340b970c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:48.033526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae230b-bc09-415e-82de-4340b970c9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:48.076548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-16ae230b-bc09-415e-82de-4340b970c9f6 None None] MFA Rules not processed for user `b836e06514734acd93d7d04eb71d05f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:48.078635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-16ae230b-bc09-415e-82de-4340b970c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:48.228861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1072/2141] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:48.234365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:48.236594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:48.387599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f4c4a-79c6-4277-91ea-0ce093f36012 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:48.395589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41a190-9fb9-43ba-85e6-46c17aa8d4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:48.396323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41a190-9fb9-43ba-85e6-46c17aa8d4b4 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:48.396775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41a190-9fb9-43ba-85e6-46c17aa8d4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:48.397140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41a190-9fb9-43ba-85e6-46c17aa8d4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:48.403529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:48.407572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41a190-9fb9-43ba-85e6-46c17aa8d4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:48.409829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41a190-9fb9-43ba-85e6-46c17aa8d4b4 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:48.421277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1070/2142] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:48.636374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae230b-bc09-415e-82de-4340b970c9f6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:48.698564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae230b-bc09-415e-82de-4340b970c9f6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:48.703628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:48.704250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:48.704570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:48.704865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] PATH_INFO: `/v3/users/b836e06514734acd93d7d04eb71d05f0` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:48.706048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b836e06514734acd93d7d04eb71d05f0)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:48.708056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:48.753843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:48.755522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b836e06514734acd93d7d04eb71d05f0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:48.756301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b836e06514734acd93d7d04eb71d05f0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:48.757349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b836e06514734acd93d7d04eb71d05f0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:48.765434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b836e06514734acd93d7d04eb71d05f0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:48.772604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b836e06514734acd93d7d04eb71d05f0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:48.790192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1073/2143] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:48 2022] DELETE /identity/v3/users/b836e06514734acd93d7d04eb71d05f0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:48.794695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:48.795009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:48.795286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:48.814697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:48.815915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:48.875785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1071/2144] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:48.885197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:48.886616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:48.945261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe8388-65cb-4207-8dca-0dc5d337dcbe admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:48.949402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7445c61-799e-4e43-9aab-c50478b29ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:48.950006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7445c61-799e-4e43-9aab-c50478b29ddb service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:48.950291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7445c61-799e-4e43-9aab-c50478b29ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:48.950568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7445c61-799e-4e43-9aab-c50478b29ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:48.959778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7445c61-799e-4e43-9aab-c50478b29ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:48.961330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7445c61-799e-4e43-9aab-c50478b29ddb service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:48.971403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1074/2145] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:49.918693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:49.921602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:49.942929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed110f-5b28-4ca2-bf34-0b65d32d2048 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:49.951879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:49.953248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:49.953689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:49.954239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] PATH_INFO: `/v3/projects/c24fb5c6dcd044dd83604b05ee70ff10` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:49.955598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24fb5c6dcd044dd83604b05ee70ff10)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:49.957950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.083835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24fb5c6dcd044dd83604b05ee70ff10', 'request_id': 'req-644a7115-6d0d-488a-9106-85121ae6529b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.090309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24fb5c6dcd044dd83604b05ee70ff10', 'request_id': 'req-644a7115-6d0d-488a-9106-85121ae6529b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.097295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24fb5c6dcd044dd83604b05ee70ff10', 'request_id': 'req-644a7115-6d0d-488a-9106-85121ae6529b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.115515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] The token cache is being invalidate because project c24fb5c6dcd044dd83604b05ee70ff10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:50.116160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.118310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-644a7115-6d0d-488a-9106-85121ae6529b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.124570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1072/2146] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:49 2022] DELETE /identity/v3/projects/c24fb5c6dcd044dd83604b05ee70ff10 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:50.125372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024d97-3cdc-48a5-aac0-db766ad58c23 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.126271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024d97-3cdc-48a5-aac0-db766ad58c23 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.126630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024d97-3cdc-48a5-aac0-db766ad58c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.148767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e6024d97-3cdc-48a5-aac0-db766ad58c23 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:50.150148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e6024d97-3cdc-48a5-aac0-db766ad58c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.216253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1075/2147] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:50.224030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902baff8-e595-4d14-8ade-8130843df189 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.224316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902baff8-e595-4d14-8ade-8130843df189 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.224637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902baff8-e595-4d14-8ade-8130843df189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.244915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-902baff8-e595-4d14-8ade-8130843df189 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:50.246100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-902baff8-e595-4d14-8ade-8130843df189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.254566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1073/2148] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:50.258769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6024d97-3cdc-48a5-aac0-db766ad58c23 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.268183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6024d97-3cdc-48a5-aac0-db766ad58c23 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.273061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.273653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.273934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.274206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.274847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:50.275149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.276765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.288633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1076/2149] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:50.292686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902baff8-e595-4d14-8ade-8130843df189 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.302487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902baff8-e595-4d14-8ade-8130843df189 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.307050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.307635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.307913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.308184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.308841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.310734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.337409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1074/2150] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:50 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:56:50.341574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.352215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb93e5f-31b4-4220-b77d-dce214c27bfd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.401163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:50.411212 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.411786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.412072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.412348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.413018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.414926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.435743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1077/2151] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:50 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:50.440395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.450795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b0f86-9923-4d5e-a43e-cd5cb63427f4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.456071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.456697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.456984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.457261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.457903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.459499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.469856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1075/2152] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:50.473747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.484284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84d97d-d1a9-4ac6-b5c0-abfc081c882f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.489205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61c931-a515-4e3b-bb9d-bf1c79c86b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.489804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61c931-a515-4e3b-bb9d-bf1c79c86b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.490086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61c931-a515-4e3b-bb9d-bf1c79c86b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.490362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61c931-a515-4e3b-bb9d-bf1c79c86b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.491008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61c931-a515-4e3b-bb9d-bf1c79c86b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.492685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61c931-a515-4e3b-bb9d-bf1c79c86b6f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.503285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1078/2153] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:50.507425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.517525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef13f8-b92a-4833-849f-bd032027e425 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.522077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.522712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.522989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.523267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] PATH_INFO: `/v3/projects/aa6f82b74a884ff9a2d0a6937761dcad/users/ad3e5aa399ba45afaa58c1d949e23445/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.538137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6f82b74a884ff9a2d0a6937761dcad, user_id=ad3e5aa399ba45afaa58c1d949e23445, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.540790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.554534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1076/2154] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:50 2022] PUT /identity/v3/projects/aa6f82b74a884ff9a2d0a6937761dcad/users/ad3e5aa399ba45afaa58c1d949e23445/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:50.559442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.559733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.560015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.578777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:50.580127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.635464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.637220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.643353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1079/2155] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:50.653766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db31666-bb95-4451-9f5d-3b01e7d53c83 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.654317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.656327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.658985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.659610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.659888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.660162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] PATH_INFO: `/v3/users/647fd6ae77704d5e8dd59951621b990e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.661392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647fd6ae77704d5e8dd59951621b990e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.663277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.673890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:50.713409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647fd6ae77704d5e8dd59951621b990e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.714072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647fd6ae77704d5e8dd59951621b990e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.716132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289bdce-e241-4462-a74a-d3eb4bab754b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.720901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa9cc7-d3bb-4acd-a24e-68d91e0b413b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.721514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9cc7-d3bb-4acd-a24e-68d91e0b413b service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.721658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647fd6ae77704d5e8dd59951621b990e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.721798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9cc7-d3bb-4acd-a24e-68d91e0b413b service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.722076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9cc7-d3bb-4acd-a24e-68d91e0b413b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.722322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647fd6ae77704d5e8dd59951621b990e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.723877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d0aa9cc7-d3bb-4acd-a24e-68d91e0b413b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.729923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647fd6ae77704d5e8dd59951621b990e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:50.737045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa9cc7-d3bb-4acd-a24e-68d91e0b413b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.738481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa9cc7-d3bb-4acd-a24e-68d91e0b413b service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.748249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1080/2156] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:56:50.748765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1077/2157] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:50 2022] DELETE /identity/v3/users/647fd6ae77704d5e8dd59951621b990e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:50.753702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.753989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.754269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.774309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:50.775535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.849112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1081/2158] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:50.860359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:50.862130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:50.925009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51cf9d8-b282-4da0-b550-5578c184b025 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:50.928924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:50.929620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:50.929946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:50.930245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:50.941279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:50.942836 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:50.954171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1078/2159] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:56:51.426032 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:51.428072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:51.446354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60c248-0686-4d6a-93cf-0ad7fafb8881 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:51.454424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:51.455066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:51.455353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:51.455630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] PATH_INFO: `/v3/projects/26abf5c9f7b04b49ad3d5078532f487e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:51.456805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26abf5c9f7b04b49ad3d5078532f487e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:51.458879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:51.473884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:51.513026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26abf5c9f7b04b49ad3d5078532f487e', 'request_id': 'req-d429870c-3f44-406a-b926-fc55139a1579'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.519257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26abf5c9f7b04b49ad3d5078532f487e', 'request_id': 'req-d429870c-3f44-406a-b926-fc55139a1579'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.527030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26abf5c9f7b04b49ad3d5078532f487e', 'request_id': 'req-d429870c-3f44-406a-b926-fc55139a1579'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.539064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] The token cache is being invalidate because project 26abf5c9f7b04b49ad3d5078532f487e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:51.539459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.540128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d429870c-3f44-406a-b926-fc55139a1579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.541663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1082/2160] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:51 2022] DELETE /identity/v3/projects/26abf5c9f7b04b49ad3d5078532f487e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:51.545828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:51.557086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a45eb-4bb0-4d3a-b2a8-1fca3ddd01f8 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:51.627240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:51.627852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:51.628130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:51.628430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] PATH_INFO: `/v3/users/98becb6b571e4bcbaee2aa851428d840` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:51.629563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98becb6b571e4bcbaee2aa851428d840)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:51.631550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:51.685149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3470244-144d-4d97-9369-e579c20f45f7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:51.685429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3470244-144d-4d97-9369-e579c20f45f7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:51.685724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3470244-144d-4d97-9369-e579c20f45f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:51.686502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:51.703801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98becb6b571e4bcbaee2aa851428d840'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.704914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98becb6b571e4bcbaee2aa851428d840'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.715754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98becb6b571e4bcbaee2aa851428d840'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.719166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c3470244-144d-4d97-9369-e579c20f45f7 None None] MFA Rules not processed for user `ad3e5aa399ba45afaa58c1d949e23445`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:51.720439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c3470244-144d-4d97-9369-e579c20f45f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:51.726834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98becb6b571e4bcbaee2aa851428d840'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.740159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98becb6b571e4bcbaee2aa851428d840'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:51.768521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1079/2161] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:51 2022] DELETE /identity/v3/users/98becb6b571e4bcbaee2aa851428d840 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:51.804929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1083/2162] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:51.810825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:51.812977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:51.899811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de2a72-5546-4d32-b69a-bc2f4ca53465 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:51.904833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:51.906069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:51.906421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:51.906780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:51.907491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:51.909536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:51.943106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1080/2163] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:51 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:51.945316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3470244-144d-4d97-9369-e579c20f45f7 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:51.961779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3470244-144d-4d97-9369-e579c20f45f7 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.031077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.031697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.031980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.032254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.032922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.034843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.062397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1084/2164] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:51 2022] POST /identity/v3/users => generated 308 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:52.063935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.074943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffba37-a37c-40cc-8632-4fce35baf8a7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.082298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.083142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.083584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.084064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.084916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.087092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.094222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.095979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:52.099544 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1081/2165] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:52.104049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.120497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74da81e-6145-4cef-b404-edaaac1f2821 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.120698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03263a00-1af8-4970-a703-774c7df25f5c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.127381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.128059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.128344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.128695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] PATH_INFO: `/v3/projects/1395b683496b4599a37baa5bad94ff89/users/6c7385dd54474b288c0dff08898e947d/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.129717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.130538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.131062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.131422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] PATH_INFO: `/v3/projects/fbe6f88adbc843a09980a1ec696777c2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.132992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe6f88adbc843a09980a1ec696777c2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.135077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.148338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1395b683496b4599a37baa5bad94ff89, user_id=6c7385dd54474b288c0dff08898e947d, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.150559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:52.151197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.171953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1082/2166] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:52 2022] PUT /identity/v3/projects/1395b683496b4599a37baa5bad94ff89/users/6c7385dd54474b288c0dff08898e947d/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:52.175922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.201406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe6f88adbc843a09980a1ec696777c2', 'request_id': 'req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:52.208968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe6f88adbc843a09980a1ec696777c2', 'request_id': 'req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:52.219079 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe6f88adbc843a09980a1ec696777c2', 'request_id': 'req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:52.234654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] The token cache is being invalidate because project fbe6f88adbc843a09980a1ec696777c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:52.234972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:52.235646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ebbd5bbc-124d-4713-a45e-8c5d97b7677e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:52.237442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1085/2167] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:52 2022] DELETE /identity/v3/projects/fbe6f88adbc843a09980a1ec696777c2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:52.242200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b249f2-1d38-4162-b624-a71bfd1925a4 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.242722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b249f2-1d38-4162-b624-a71bfd1925a4 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.242843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b249f2-1d38-4162-b624-a71bfd1925a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.258467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dfb4d-3860-4101-a83f-b2248d1a15fd admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.262729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:52.263535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e2b249f2-1d38-4162-b624-a71bfd1925a4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:52.265520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e2b249f2-1d38-4162-b624-a71bfd1925a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:52.324783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.325668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.325791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.326118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.326765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.327934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1086/2168] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:52.328966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.335504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cffc3-e24f-4b18-9fa3-7e5bed183185 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.335795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cffc3-e24f-4b18-9fa3-7e5bed183185 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.336074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cffc3-e24f-4b18-9fa3-7e5bed183185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.339193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1083/2169] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:56:52.343872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.345626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:52.358089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2764a3f-84b8-495f-b90c-50eacf5092bc admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.359453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-585cffc3-e24f-4b18-9fa3-7e5bed183185 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:52.360698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-585cffc3-e24f-4b18-9fa3-7e5bed183185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:52.363084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.363737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.364017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.364293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] PATH_INFO: `/v3/projects/1395b683496b4599a37baa5bad94ff89/users/6c7385dd54474b288c0dff08898e947d/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.366293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1395b683496b4599a37baa5bad94ff89, user_id=6c7385dd54474b288c0dff08898e947d, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.368943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.372748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1087/2170] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:52.376756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cffc3-e24f-4b18-9fa3-7e5bed183185 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.384577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1084/2171] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:52 2022] PUT /identity/v3/projects/1395b683496b4599a37baa5bad94ff89/users/6c7385dd54474b288c0dff08898e947d/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:52.388771 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cffc3-e24f-4b18-9fa3-7e5bed183185 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.461440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.462123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.462402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.462682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.463346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:52.463655 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.466354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.480818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1088/2172] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:56:52.485264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.504728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eafafc8-a28a-4865-ab5c-67bdfabcba95 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.512815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.515194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.515589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.516172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.517168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.520522 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.567125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1085/2173] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:52 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:52.571557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.588938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd3773-6a0a-41bf-9c1c-b69ecbfaf4bc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.643990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:52.696612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.697622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.697960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.698257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.699005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.701000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.730846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1089/2174] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:52 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:52.736495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.753280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4498045-ff31-43ce-940b-75096b7e07d7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.760292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.761054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.761329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.761608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.762593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.764305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.779592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1086/2175] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:52.784652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.797399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759490e-e9ea-4fdf-b0e9-89158c85c8d2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.802956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549130e-5568-4d13-945e-9bfa9059e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.803366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549130e-5568-4d13-945e-9bfa9059e7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.803608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549130e-5568-4d13-945e-9bfa9059e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.803893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549130e-5568-4d13-945e-9bfa9059e7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.804605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549130e-5568-4d13-945e-9bfa9059e7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.806421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549130e-5568-4d13-945e-9bfa9059e7e8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.824765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1090/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:52.829868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:52.841936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a03ee7-2bb4-4195-9703-d488a9d30e29 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:52.849366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:52.850380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.850920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.851369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] PATH_INFO: `/v3/projects/9bb02a0d9f814cf1a9646b316fd83a02/users/6c7b567600e64108bbea1d92d1559cba/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.870941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb02a0d9f814cf1a9646b316fd83a02, user_id=6c7b567600e64108bbea1d92d1559cba, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:52.873864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:52.892936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1087/2177] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:52 2022] PUT /identity/v3/projects/9bb02a0d9f814cf1a9646b316fd83a02/users/6c7b567600e64108bbea1d92d1559cba/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:52.905652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d94e-88ae-43d5-a6f3-43b0b8b707f2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:52.906204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d94e-88ae-43d5-a6f3-43b0b8b707f2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:52.906562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9d94e-88ae-43d5-a6f3-43b0b8b707f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:52.940478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-30e9d94e-88ae-43d5-a6f3-43b0b8b707f2 None None] MFA Rules not processed for user `6c7b567600e64108bbea1d92d1559cba`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:52.942197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-30e9d94e-88ae-43d5-a6f3-43b0b8b707f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:53.029376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1091/2178] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:53.043102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:53.045125 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:53.142271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc38b45-a602-4029-840e-131ea5a7528a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:53.146158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:53.146791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:53.147077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:53.147359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:53.158779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:53.161358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:53.172674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1088/2179] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:53.329617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899720f-3903-4305-a709-b3fcec6408e8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:53.330364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899720f-3903-4305-a709-b3fcec6408e8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:53.331121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899720f-3903-4305-a709-b3fcec6408e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:53.373352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b899720f-3903-4305-a709-b3fcec6408e8 None None] MFA Rules not processed for user `6c7385dd54474b288c0dff08898e947d`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:53.375812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b899720f-3903-4305-a709-b3fcec6408e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:53.492921 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1092/2180] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:54.832446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:54.870411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:54.895647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da519c9-775f-4f31-87c5-a9dc7cbfe0c2 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:54.900160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:54.900832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:54.901117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:54.901395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] PATH_INFO: `/v3/users/ad3e5aa399ba45afaa58c1d949e23445` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:54.902611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3e5aa399ba45afaa58c1d949e23445)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:54.904771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:54.951124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3e5aa399ba45afaa58c1d949e23445'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:54.951771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3e5aa399ba45afaa58c1d949e23445'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:54.958585 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3e5aa399ba45afaa58c1d949e23445'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:54.959216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3e5aa399ba45afaa58c1d949e23445'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:54.966455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3e5aa399ba45afaa58c1d949e23445'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:54.984292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1089/2181] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:54 2022] DELETE /identity/v3/users/ad3e5aa399ba45afaa58c1d949e23445 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:55.191942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899720f-3903-4305-a709-b3fcec6408e8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:55.209388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899720f-3903-4305-a709-b3fcec6408e8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:55.231825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:55.277911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:55.278559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:55.278841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:55.279162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] PATH_INFO: `/v3/projects/aa6f82b74a884ff9a2d0a6937761dcad` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:55.280903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6f82b74a884ff9a2d0a6937761dcad)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:55.283179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:55.350552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6f82b74a884ff9a2d0a6937761dcad', 'request_id': 'req-8f2a17a2-0a40-4929-a32a-26ea171048fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.359298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6f82b74a884ff9a2d0a6937761dcad', 'request_id': 'req-8f2a17a2-0a40-4929-a32a-26ea171048fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.371555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6f82b74a884ff9a2d0a6937761dcad', 'request_id': 'req-8f2a17a2-0a40-4929-a32a-26ea171048fd'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.391158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] The token cache is being invalidate because project aa6f82b74a884ff9a2d0a6937761dcad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:55.391581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.392369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.394156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1093/2182] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:55 2022] DELETE /identity/v3/projects/aa6f82b74a884ff9a2d0a6937761dcad => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:55.398613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:55.400207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:55.424507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a7573-abf8-4ffb-b4fc-312e940b66b6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:55.524991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:55.525980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:55.526358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:55.526712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] PATH_INFO: `/v3/users/6c7385dd54474b288c0dff08898e947d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:55.527964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7385dd54474b288c0dff08898e947d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:55.530789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:55.597962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7385dd54474b288c0dff08898e947d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.598237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7385dd54474b288c0dff08898e947d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.619737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7385dd54474b288c0dff08898e947d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.630665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7385dd54474b288c0dff08898e947d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.634968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:55.643566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7385dd54474b288c0dff08898e947d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.673244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1090/2183] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:55 2022] DELETE /identity/v3/users/6c7385dd54474b288c0dff08898e947d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:55.849222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:55.850865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:55.865838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a17a2-0a40-4929-a32a-26ea171048fd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:55.898305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:55.899722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:55.935151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:55.936128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:55.936753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:55.937036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] PATH_INFO: `/v3/projects/1395b683496b4599a37baa5bad94ff89` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:55.938195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1395b683496b4599a37baa5bad94ff89)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:55.940421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:55.981578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153731a-9dec-451d-b3c3-106c6bc7b33a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:55.992253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1395b683496b4599a37baa5bad94ff89', 'request_id': 'req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:55.996727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:55.999228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1395b683496b4599a37baa5bad94ff89', 'request_id': 'req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.008455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1395b683496b4599a37baa5bad94ff89', 'request_id': 'req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.024589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] The token cache is being invalidate because project 1395b683496b4599a37baa5bad94ff89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:56.024887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.025557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bfbb96c9-74c1-4a0a-bf15-b978f57cc311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.027068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1094/2184] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:55 2022] DELETE /identity/v3/projects/1395b683496b4599a37baa5bad94ff89 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:56.032328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ed15c-7d2b-44ee-8cf2-bf490e152cd7 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.032864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ed15c-7d2b-44ee-8cf2-bf490e152cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.033247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ed15c-7d2b-44ee-8cf2-bf490e152cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.048552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.049322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.049598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.049877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] PATH_INFO: `/v3/users/6c7b567600e64108bbea1d92d1559cba` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.051266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7b567600e64108bbea1d92d1559cba)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.053717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.059722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-795ed15c-7d2b-44ee-8cf2-bf490e152cd7 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:56.061131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-795ed15c-7d2b-44ee-8cf2-bf490e152cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:56.070379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1095/2185] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:56.078554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89d35c-02db-440e-a903-9ed057c284da None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.078844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89d35c-02db-440e-a903-9ed057c284da None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.079125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89d35c-02db-440e-a903-9ed057c284da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.101265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6d89d35c-02db-440e-a903-9ed057c284da None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:56.102422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6d89d35c-02db-440e-a903-9ed057c284da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:56.110395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1096/2186] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:56:56.114953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89d35c-02db-440e-a903-9ed057c284da None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.117611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7b567600e64108bbea1d92d1559cba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.118375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7b567600e64108bbea1d92d1559cba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.124786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89d35c-02db-440e-a903-9ed057c284da None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.126746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7b567600e64108bbea1d92d1559cba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.127562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7b567600e64108bbea1d92d1559cba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.129604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.130208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.130504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.130759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.131474 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:56:56.131779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.133591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.138347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-47c9321c-be8f-43da-a419-6a9555473435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7b567600e64108bbea1d92d1559cba'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:56.150091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1097/2187] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:56:56.151631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.153384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:56.161519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:56.169496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd605b6-752f-4d90-ad3d-d583efc606ca admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.170478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1091/2188] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:56:55 2022] DELETE /identity/v3/users/6c7b567600e64108bbea1d92d1559cba => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:56.172094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.172420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.172930 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.200256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:56.201691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:56.277619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.278523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.278886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.279236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.280848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.283789 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.301383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1092/2189] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:56.317044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.319857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:56.328690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1098/2190] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:56 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:56.330122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.401430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272ae20-d7e5-4340-812f-272b1df7a682 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.430051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2805faa-ae4b-4040-8006-4400bc90a3da admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.436993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.438050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.438351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.438711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.440359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.443088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.470290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.470997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.471581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.471713 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1099/2191] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:56 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:56.471849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.475663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.482374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.484874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.487745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135a43b-b14c-4a21-8d82-a6d1c07d855f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.492827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.493433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.493713 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.493986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.494645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.496234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.497216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1093/2192] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:56.510498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1100/2193] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:56.514221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.526244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e17f5-f5c2-4d1a-91a8-9d0f0fe57062 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.532223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbade4-acf3-406f-85e0-bdb0355a2c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.533345 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbade4-acf3-406f-85e0-bdb0355a2c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.533945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbade4-acf3-406f-85e0-bdb0355a2c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.534482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbade4-acf3-406f-85e0-bdb0355a2c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.535285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbade4-acf3-406f-85e0-bdb0355a2c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.537133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbade4-acf3-406f-85e0-bdb0355a2c43 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.563448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1094/2194] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:56.567494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.601034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b63db-2970-4920-b772-197619317d51 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.607242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.607915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.608229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.608634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] PATH_INFO: `/v3/projects/8e024e69bcc3461086b9ed58a80c39c6/users/5d3fd57892624ff58f30590743d48453/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.629195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e024e69bcc3461086b9ed58a80c39c6, user_id=5d3fd57892624ff58f30590743d48453, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.632635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.636773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:56.664738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1101/2195] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:56 2022] PUT /identity/v3/projects/8e024e69bcc3461086b9ed58a80c39c6/users/5d3fd57892624ff58f30590743d48453/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:56.687639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.688875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.689294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.735135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] MFA Rules not processed for user `5d3fd57892624ff58f30590743d48453`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:56.735135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:56.802187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:56.840435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1095/2196] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:56.843511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.942026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:56.943621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:56.965681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa7e53-5f23-4737-95c5-3569cfe4cef5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.971621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:56.972681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:56.973107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:56.973523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] PATH_INFO: `/v3/projects/9bb02a0d9f814cf1a9646b316fd83a02` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:56.974998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb02a0d9f814cf1a9646b316fd83a02)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:56.978687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:56.986016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9404880-dd07-4327-b6ff-8c286e60cbd8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:56.998234 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.000373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.000763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.001304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.002162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.004867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.044459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb02a0d9f814cf1a9646b316fd83a02', 'request_id': 'req-9ff978ab-876c-4612-a4f7-cdfe086f3a48'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:57.048871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1102/2197] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:56:56 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:57.053367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:57.054569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb02a0d9f814cf1a9646b316fd83a02', 'request_id': 'req-9ff978ab-876c-4612-a4f7-cdfe086f3a48'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:57.062774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb02a0d9f814cf1a9646b316fd83a02', 'request_id': 'req-9ff978ab-876c-4612-a4f7-cdfe086f3a48'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:57.078676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] The token cache is being invalidate because project 9bb02a0d9f814cf1a9646b316fd83a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:56:57.079001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:57.080679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:56:57.083105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1096/2198] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:56:56 2022] DELETE /identity/v3/projects/9bb02a0d9f814cf1a9646b316fd83a02 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:57.143975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d2aa7-5323-40f9-9138-5935c719d006 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:57.149228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.149875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.150160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.150446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.151168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.153468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.194342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1103/2199] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:56:57 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:56:57.198839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:57.200511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:57.286309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff978ab-876c-4612-a4f7-cdfe086f3a48 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:57.291571 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.292410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.292780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.293126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.294163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.296801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.308267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1097/2200] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:57.312735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:57.323025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7b583-b1f3-4013-85cc-96cb0260eecd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:57.327633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.328291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.328602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.328883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] PATH_INFO: `/v3/projects/abc087a832534c40ab3aa787661033b6/users/16d9c931fde14a62aa2d06f0ce53b233/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.344712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc087a832534c40ab3aa787661033b6, user_id=16d9c931fde14a62aa2d06f0ce53b233, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.347974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.361389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1104/2201] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:57 2022] PUT /identity/v3/projects/abc087a832534c40ab3aa787661033b6/users/16d9c931fde14a62aa2d06f0ce53b233/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:56:57.365638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:57.376227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bfc78-d90b-4335-b9cc-f89bdad46034 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:57.431007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:57.438891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7b327-8d0b-4151-ae7f-ba65b559baca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.439529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b327-8d0b-4151-ae7f-ba65b559baca admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.440119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b327-8d0b-4151-ae7f-ba65b559baca admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.440655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7b327-8d0b-4151-ae7f-ba65b559baca admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.441574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b327-8d0b-4151-ae7f-ba65b559baca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.444992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7b327-8d0b-4151-ae7f-ba65b559baca admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.455694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1098/2202] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:56:57.459840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:57.470398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59eeba-a580-4250-b6e9-b2e6dad7af81 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:57.475098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.475759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.476066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.476344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] PATH_INFO: `/v3/projects/abc087a832534c40ab3aa787661033b6/users/16d9c931fde14a62aa2d06f0ce53b233/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.478303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc087a832534c40ab3aa787661033b6, user_id=16d9c931fde14a62aa2d06f0ce53b233, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.481066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.493351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1105/2203] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:56:57 2022] PUT /identity/v3/projects/abc087a832534c40ab3aa787661033b6/users/16d9c931fde14a62aa2d06f0ce53b233/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:56:57.504256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c27ac-55b7-4858-8f3d-758a000d102e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.504663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c27ac-55b7-4858-8f3d-758a000d102e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.504967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c27ac-55b7-4858-8f3d-758a000d102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.533168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e10c27ac-55b7-4858-8f3d-758a000d102e None None] MFA Rules not processed for user `16d9c931fde14a62aa2d06f0ce53b233`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:56:57.534411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e10c27ac-55b7-4858-8f3d-758a000d102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:57.620243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1099/2204] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:56:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:56:57.632878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:57.634602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:57.673764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:56:57.699909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82939ce-b9ef-4fdd-879b-f2b266580309 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:57.704546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0848e-d1d4-4924-ad30-06bddb3307bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.705162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0848e-d1d4-4924-ad30-06bddb3307bc service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.705440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0848e-d1d4-4924-ad30-06bddb3307bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.705736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0848e-d1d4-4924-ad30-06bddb3307bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.716899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0848e-d1d4-4924-ad30-06bddb3307bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.718399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0848e-d1d4-4924-ad30-06bddb3307bc service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.728104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1106/2205] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:56:57.812755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c27ac-55b7-4858-8f3d-758a000d102e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:56:57.824064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c27ac-55b7-4858-8f3d-758a000d102e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:56:57.828410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb614bd-44de-4f9b-b19b-2ab3c53158e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:56:57.829143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb614bd-44de-4f9b-b19b-2ab3c53158e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:56:57.829531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb614bd-44de-4f9b-b19b-2ab3c53158e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:56:57.829939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb614bd-44de-4f9b-b19b-2ab3c53158e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:56:57.831837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bcb614bd-44de-4f9b-b19b-2ab3c53158e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:56:57.900992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb614bd-44de-4f9b-b19b-2ab3c53158e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:56:57.902499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb614bd-44de-4f9b-b19b-2ab3c53158e8 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:56:57.911919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1100/2206] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:56:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:03.302930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57764-5219-4a24-9c89-f4aac2d650ea None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:03.303470 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57764-5219-4a24-9c89-f4aac2d650ea None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:03.303717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57764-5219-4a24-9c89-f4aac2d650ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:03.323478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fcd57764-5219-4a24-9c89-f4aac2d650ea None None] MFA Rules not processed for user `5ed2a2188b904bde9406ad42b640037b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:03.324903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fcd57764-5219-4a24-9c89-f4aac2d650ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:03.386627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1107/2207] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:03.671940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f65dd-af2b-440f-ba01-6b35a0fdd840 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:03.672508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f65dd-af2b-440f-ba01-6b35a0fdd840 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:03.672739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f65dd-af2b-440f-ba01-6b35a0fdd840 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:03.674380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1101/2208] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:57:03.691086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:03.691761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:03.692869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:03.725534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] MFA Rules not processed for user `28ecb57b15c24e4488eb3c78413194f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:03.726770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:03.798788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f65dd-af2b-440f-ba01-6b35a0fdd840 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:03.800568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5f3f65dd-af2b-440f-ba01-6b35a0fdd840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:03.817760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1108/2209] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:57:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:03.846121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:03.847552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:03.862505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e56324-6bff-4d6e-a34f-8a89c0d3db98 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:03.869052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:03.869939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:03.870331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:03.871064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:03.883102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:03.884983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:03.898196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1109/2210] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:57:03.909295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f65dd-af2b-440f-ba01-6b35a0fdd840 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:03.915865 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:03.916556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:03.917180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:03.917180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] PATH_INFO: `/v3/users/d0ab0630297b45cc8eb09ef625810aee` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:03.919132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ab0630297b45cc8eb09ef625810aee)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:03.920685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:03.947123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:03.980781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ab0630297b45cc8eb09ef625810aee'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:03.981516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ab0630297b45cc8eb09ef625810aee'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:03.995875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ab0630297b45cc8eb09ef625810aee'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:03.997005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ab0630297b45cc8eb09ef625810aee'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.026057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ab0630297b45cc8eb09ef625810aee'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.053847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1102/2211] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:03 2022] DELETE /identity/v3/users/d0ab0630297b45cc8eb09ef625810aee => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:57:04.265696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:04.286411 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1518c-b32c-4498-9627-1af1edc9851a service placement] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:04.400803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:04.401820 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:04.402181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:04.402461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] PATH_INFO: `/v3/projects/89ed5eb1fb0e4040aae72e1626de4ac4` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:04.404120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ed5eb1fb0e4040aae72e1626de4ac4)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:04.407400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:04.414453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:04.457692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ed5eb1fb0e4040aae72e1626de4ac4', 'request_id': 'req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.464113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ed5eb1fb0e4040aae72e1626de4ac4', 'request_id': 'req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.471758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ed5eb1fb0e4040aae72e1626de4ac4', 'request_id': 'req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.485560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] The token cache is being invalidate because project 89ed5eb1fb0e4040aae72e1626de4ac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:04.485876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.486806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.488304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1110/2212] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:04 2022] DELETE /identity/v3/projects/89ed5eb1fb0e4040aae72e1626de4ac4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:04.492455 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:04.494302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:04.508706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120a047-2591-43ae-9c8d-35e78224fe95 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:04.569350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:04.570033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:04.570453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:04.570845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] PATH_INFO: `/v3/users/535a70e1530e49969a2df5963f860415` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:04.572239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=535a70e1530e49969a2df5963f860415)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:04.578902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:04.628138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '535a70e1530e49969a2df5963f860415'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.628925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '535a70e1530e49969a2df5963f860415'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.636813 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '535a70e1530e49969a2df5963f860415'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.637475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '535a70e1530e49969a2df5963f860415'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.645647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3a3a703d-e1e8-4f47-8131-1c74a1d38339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '535a70e1530e49969a2df5963f860415'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.663556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1103/2213] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:04 2022] DELETE /identity/v3/users/535a70e1530e49969a2df5963f860415 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:04.848371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:04.849903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:04.866728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e8c6a-40bc-4c48-9b17-0258950a8fcc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:04.923538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:04.924165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:04.924478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:04.924754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] PATH_INFO: `/v3/projects/6580544e90f945cd8d7b7f839542d17a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:04.925881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6580544e90f945cd8d7b7f839542d17a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:04.927766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:04.974280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6580544e90f945cd8d7b7f839542d17a', 'request_id': 'req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.979669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6580544e90f945cd8d7b7f839542d17a', 'request_id': 'req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.986936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6580544e90f945cd8d7b7f839542d17a', 'request_id': 'req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.998027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] The token cache is being invalidate because project 6580544e90f945cd8d7b7f839542d17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:04.998318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:04.998947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d5c2fcaf-c453-4f38-a0dd-ed9ef9a704d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:05.000433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1111/2214] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:04 2022] DELETE /identity/v3/projects/6580544e90f945cd8d7b7f839542d17a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:05.005335 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926cf7-a487-45a6-919e-3e861cf61746 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.005803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926cf7-a487-45a6-919e-3e861cf61746 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.005903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82926cf7-a487-45a6-919e-3e861cf61746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.025461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-82926cf7-a487-45a6-919e-3e861cf61746 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:05.026662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-82926cf7-a487-45a6-919e-3e861cf61746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:05.036489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:05.091286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1104/2215] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:05.100463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bba91-80a3-4545-8da5-1101dd20a6c6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.100743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bba91-80a3-4545-8da5-1101dd20a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.101024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bba91-80a3-4545-8da5-1101dd20a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.126246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-695bba91-80a3-4545-8da5-1101dd20a6c6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:05.128059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-695bba91-80a3-4545-8da5-1101dd20a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:05.139706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1112/2216] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:05.144173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926cf7-a487-45a6-919e-3e861cf61746 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:05.155919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82926cf7-a487-45a6-919e-3e861cf61746 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:05.161277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:05.162009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.162396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.162775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.163590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:05.163998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:05.165899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:05.184178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1105/2217] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:05.189992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bba91-80a3-4545-8da5-1101dd20a6c6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:05.204264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695bba91-80a3-4545-8da5-1101dd20a6c6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:05.209723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:05.210494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.210832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.211191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.211894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:05.214409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:05.233433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:05.266475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:05.284466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1113/2218] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:05.284720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834300a-7302-48a2-80ef-a3de7b1ac05b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:05.392591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:05.395060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.395599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.395815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.396513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:05.400702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:05.447863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1106/2219] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:05 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:05.449292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:05.465475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3266c-bf31-4530-84d6-f503c10537f6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:05.471253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:05.472189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.472728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.473247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.474522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:05.476482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:05.492109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1114/2220] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:05.493543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:05.505232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76823b65-adc8-4a76-b2d8-f29d3902896e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:05.514829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0457ad5-0279-4afc-9efd-75154881f168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:05.515344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457ad5-0279-4afc-9efd-75154881f168 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.515623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457ad5-0279-4afc-9efd-75154881f168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.516005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0457ad5-0279-4afc-9efd-75154881f168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.516864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0457ad5-0279-4afc-9efd-75154881f168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:05.518316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0457ad5-0279-4afc-9efd-75154881f168 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:05.535956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1107/2221] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:57:05.539862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:05.553850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e0c1e-8073-4800-b3d7-9c0ee56ff7ce admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:05.558732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:05.559423 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.559700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.559972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] PATH_INFO: `/v3/projects/333cf0f2bae9451fbc4e450d9d7bd7c2/users/7732b40a6d5d439fa207fb3f4b36b83a/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.577067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=333cf0f2bae9451fbc4e450d9d7bd7c2, user_id=7732b40a6d5d439fa207fb3f4b36b83a, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:05.580251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:05.595823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1115/2222] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:05 2022] PUT /identity/v3/projects/333cf0f2bae9451fbc4e450d9d7bd7c2/users/7732b40a6d5d439fa207fb3f4b36b83a/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:05.607212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4dfa5-a970-4757-8109-213f03218927 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.607426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4dfa5-a970-4757-8109-213f03218927 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.607746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4dfa5-a970-4757-8109-213f03218927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.653266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-5db4dfa5-a970-4757-8109-213f03218927 None None] MFA Rules not processed for user `7732b40a6d5d439fa207fb3f4b36b83a`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:05.654914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-5db4dfa5-a970-4757-8109-213f03218927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:05.724693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1108/2223] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:05.737244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:05.739152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:05.797822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97ea6-1fe5-4bfa-a2e9-7d7dc8727bca admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:05.801543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0913b2-9c89-420b-be4e-f3694da01e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:05.802146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0913b2-9c89-420b-be4e-f3694da01e24 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:05.802430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0913b2-9c89-420b-be4e-f3694da01e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:05.802714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0913b2-9c89-420b-be4e-f3694da01e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:05.812156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0913b2-9c89-420b-be4e-f3694da01e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:05.813629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0913b2-9c89-420b-be4e-f3694da01e24 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:05.823352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1116/2224] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:11.260888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4dfa5-a970-4757-8109-213f03218927 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:11.273758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:11.328148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4dfa5-a970-4757-8109-213f03218927 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:11.332651 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:11.333288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:11.333605 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:11.333874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] PATH_INFO: `/v3/users/7732b40a6d5d439fa207fb3f4b36b83a` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:11.335004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7732b40a6d5d439fa207fb3f4b36b83a)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:11.336953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:11.384765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7732b40a6d5d439fa207fb3f4b36b83a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:11.385411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7732b40a6d5d439fa207fb3f4b36b83a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:11.392602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7732b40a6d5d439fa207fb3f4b36b83a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:11.393222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7732b40a6d5d439fa207fb3f4b36b83a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:11.400540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7732b40a6d5d439fa207fb3f4b36b83a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:11.418774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1109/2225] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:11 2022] DELETE /identity/v3/users/7732b40a6d5d439fa207fb3f4b36b83a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:11.423253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:11.423708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:11.423799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:11.442719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:11.443923 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:11.509311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1117/2226] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:11.519704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:11.521512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:11.579057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78e28d-d956-495c-9edb-04ce0cf7fafa admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:11.582922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd52fa-d5fb-47f9-aa82-61bd1511d890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:11.583542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd52fa-d5fb-47f9-aa82-61bd1511d890 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:11.583829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd52fa-d5fb-47f9-aa82-61bd1511d890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:11.584115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd52fa-d5fb-47f9-aa82-61bd1511d890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:11.594517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd52fa-d5fb-47f9-aa82-61bd1511d890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:11.595992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd52fa-d5fb-47f9-aa82-61bd1511d890 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:11.605386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1110/2227] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:11.936904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:11.938473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:11.952081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b78434-6a1c-4394-a9c3-aa75e39df8a2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:11.956731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:11.957367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:11.957678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:11.957953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] PATH_INFO: `/v3/projects/333cf0f2bae9451fbc4e450d9d7bd7c2` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:11.959085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=333cf0f2bae9451fbc4e450d9d7bd7c2)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:11.962060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.013972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '333cf0f2bae9451fbc4e450d9d7bd7c2', 'request_id': 'req-414c7256-cddd-4da9-868a-d68a2802c539'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:12.019430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '333cf0f2bae9451fbc4e450d9d7bd7c2', 'request_id': 'req-414c7256-cddd-4da9-868a-d68a2802c539'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:12.021128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:12.027827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '333cf0f2bae9451fbc4e450d9d7bd7c2', 'request_id': 'req-414c7256-cddd-4da9-868a-d68a2802c539'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:12.041491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] The token cache is being invalidate because project 333cf0f2bae9451fbc4e450d9d7bd7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:12.041788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:12.042452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-414c7256-cddd-4da9-868a-d68a2802c539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:12.043947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1118/2228] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:11 2022] DELETE /identity/v3/projects/333cf0f2bae9451fbc4e450d9d7bd7c2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:12.050020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086ead9-5bea-45bb-99c7-04063274b96b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.050374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086ead9-5bea-45bb-99c7-04063274b96b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.050755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086ead9-5bea-45bb-99c7-04063274b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.071090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0086ead9-5bea-45bb-99c7-04063274b96b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:12.072368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0086ead9-5bea-45bb-99c7-04063274b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:12.108147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:12.142462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1111/2229] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:12.151880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d4703-bc92-4307-bf3e-27157127a8d3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.152090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d4703-bc92-4307-bf3e-27157127a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.152367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d4703-bc92-4307-bf3e-27157127a8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.186606 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-881d4703-bc92-4307-bf3e-27157127a8d3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:12.187818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-881d4703-bc92-4307-bf3e-27157127a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:12.196078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1119/2230] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:12.200636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086ead9-5bea-45bb-99c7-04063274b96b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.210998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086ead9-5bea-45bb-99c7-04063274b96b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.215613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.216189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.216523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.216798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.217449 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:12.217751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.219411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.231834 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1112/2231] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:12.236537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d4703-bc92-4307-bf3e-27157127a8d3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.245722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d4703-bc92-4307-bf3e-27157127a8d3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.251077 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.251718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.252000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.252291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.252946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.254832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.284368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1120/2232] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:12 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:12.288643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.298747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a01bb8-6db8-436e-a699-4c755919dc8b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.356326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.356964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.357811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.358083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.358706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.360659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.394764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1113/2233] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:12 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:12.396161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.408031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b83a-c93b-42c0-b6ea-14e78a63b228 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.412847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.413461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.413900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.414186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.414837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.416447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.428190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1121/2234] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:57:12.433063 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.443978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d49b16-f737-465e-b2c0-25d1565b56e2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.449046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447716-42e0-48dd-8a68-0f859af5567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.449661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447716-42e0-48dd-8a68-0f859af5567a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.449943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447716-42e0-48dd-8a68-0f859af5567a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.450367 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447716-42e0-48dd-8a68-0f859af5567a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.451641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447716-42e0-48dd-8a68-0f859af5567a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.453250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447716-42e0-48dd-8a68-0f859af5567a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.474293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1114/2235] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:12.475647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.488947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e8713-c6d4-41d1-a253-f477daee0bb8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.494573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.495294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.495828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.496162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] PATH_INFO: `/v3/projects/0fdb4566efe74fafb5bca0ae6754d6b8/users/768952a6a3c5449f8db42ff6fc614b75/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.523887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdb4566efe74fafb5bca0ae6754d6b8, user_id=768952a6a3c5449f8db42ff6fc614b75, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.526617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.542262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1122/2236] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:12 2022] PUT /identity/v3/projects/0fdb4566efe74fafb5bca0ae6754d6b8/users/768952a6a3c5449f8db42ff6fc614b75/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:57:12.551957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4ba97-ee99-4963-83cc-e14b84e0aa6c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.552315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4ba97-ee99-4963-83cc-e14b84e0aa6c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.552626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4ba97-ee99-4963-83cc-e14b84e0aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.582773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e2a4ba97-ee99-4963-83cc-e14b84e0aa6c None None] MFA Rules not processed for user `768952a6a3c5449f8db42ff6fc614b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:12.584053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e2a4ba97-ee99-4963-83cc-e14b84e0aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:12.657077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1115/2237] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:12.661491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.723395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e96c93-3b87-47fc-814a-a5534ed7aafb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.728122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.728762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.729050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.729329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.730094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.732003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.764269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1123/2238] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:12 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:12.765377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4ba97-ee99-4963-83cc-e14b84e0aa6c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.776534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4ba97-ee99-4963-83cc-e14b84e0aa6c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.817482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:12.851540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.852161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.852491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.852771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.853422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.855350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.881752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1116/2239] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:12 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:57:12.883061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.893671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7af53c-ac59-4a02-9f27-da895ac9695c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.898340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.898954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.899235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.899511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.900159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.901803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.914044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1124/2240] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:12.918302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.929721 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad13c7-c912-46d1-bc6c-3198ab31d9bf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.934519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46110c3e-c80b-4043-a571-8fde20f63ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.935127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110c3e-c80b-4043-a571-8fde20f63ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.935444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110c3e-c80b-4043-a571-8fde20f63ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.935725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46110c3e-c80b-4043-a571-8fde20f63ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.936375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46110c3e-c80b-4043-a571-8fde20f63ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.938016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46110c3e-c80b-4043-a571-8fde20f63ff5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:12.948920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1117/2241] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:12.953104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:12.963210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8eec0d-0507-442f-814f-251033d2f494 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:12.968489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:12.969250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:12.969532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:12.969815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] PATH_INFO: `/v3/projects/3e57fe321f0b4c5581006b76f62d7e05/users/734bd9d00d8849e087b7a6c7bd44dbe6/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:12.986638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e57fe321f0b4c5581006b76f62d7e05, user_id=734bd9d00d8849e087b7a6c7bd44dbe6, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:12.989420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.004189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1125/2242] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:12 2022] PUT /identity/v3/projects/3e57fe321f0b4c5581006b76f62d7e05/users/734bd9d00d8849e087b7a6c7bd44dbe6/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:13.015443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969511db-2fb7-4b45-950d-aeca885b826e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.015728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969511db-2fb7-4b45-950d-aeca885b826e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.016005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969511db-2fb7-4b45-950d-aeca885b826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.046021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-969511db-2fb7-4b45-950d-aeca885b826e None None] MFA Rules not processed for user `734bd9d00d8849e087b7a6c7bd44dbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:13.047309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-969511db-2fb7-4b45-950d-aeca885b826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:13.116727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1118/2243] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:13.121185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:13.156135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:13.184940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa3f08-61cc-4196-8265-44616e5aba0f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:13.191486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:13.192104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.192408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.192684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.193321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:13.195573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.235138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1126/2244] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:13 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:13.239626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969511db-2fb7-4b45-950d-aeca885b826e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:13.255373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969511db-2fb7-4b45-950d-aeca885b826e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:13.317478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:13.318122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.318374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.318837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.319514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:13.325233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.343990 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1119/2245] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:13 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:13.348208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:13.358437 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126bfcb-a019-48ed-85ca-dd9c6f392be5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:13.363357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:13.363963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.364248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.364559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.365246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:13.366804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.377594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1127/2246] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:13.381928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:13.392446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a1f1-7a84-45f6-8dfe-447ecbf56265 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:13.397179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:13.397830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.398115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.398394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] PATH_INFO: `/v3/projects/d5813de9a10f4961b5aefe8ac1c08c09/users/9d6a975ec99d4e748a5903ae810d5cc7/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.413923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5813de9a10f4961b5aefe8ac1c08c09, user_id=9d6a975ec99d4e748a5903ae810d5cc7, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:13.416647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.429955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1120/2247] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:13 2022] PUT /identity/v3/projects/d5813de9a10f4961b5aefe8ac1c08c09/users/9d6a975ec99d4e748a5903ae810d5cc7/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:13.435002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:13.445507 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022e68f-b302-4af8-83f4-4a6deed7dc0f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:13.505073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f884f-28a5-4556-9d77-59fc0d2d11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:13.505583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f884f-28a5-4556-9d77-59fc0d2d11ee admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.505867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f884f-28a5-4556-9d77-59fc0d2d11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.506146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f884f-28a5-4556-9d77-59fc0d2d11ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.506797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f884f-28a5-4556-9d77-59fc0d2d11ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:13.508416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f884f-28a5-4556-9d77-59fc0d2d11ee admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.519139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1128/2248] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:13.523465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:13.528919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:13.535845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205819b-fbfe-4214-a52e-fc97016409b1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:13.540934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:13.541736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.542018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.542340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] PATH_INFO: `/v3/projects/d5813de9a10f4961b5aefe8ac1c08c09/users/9d6a975ec99d4e748a5903ae810d5cc7/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.544374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5813de9a10f4961b5aefe8ac1c08c09, user_id=9d6a975ec99d4e748a5903ae810d5cc7, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:13.547092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.557765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1121/2249] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:13 2022] PUT /identity/v3/projects/d5813de9a10f4961b5aefe8ac1c08c09/users/9d6a975ec99d4e748a5903ae810d5cc7/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:13.569712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074d3f7-e7b4-462d-9c84-5e4445f67b63 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.569999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074d3f7-e7b4-462d-9c84-5e4445f67b63 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.570279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074d3f7-e7b4-462d-9c84-5e4445f67b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.599995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6074d3f7-e7b4-462d-9c84-5e4445f67b63 None None] MFA Rules not processed for user `9d6a975ec99d4e748a5903ae810d5cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:13.601250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6074d3f7-e7b4-462d-9c84-5e4445f67b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:13.669835 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1129/2250] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:13.681212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:13.682933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:13.744708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14113b-0491-4467-84d9-7583f5f26d38 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:13.748438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:13.749056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:13.749363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:13.749639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:13.807253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:13.808663 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:13.817765 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1122/2251] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:15.322244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074d3f7-e7b4-462d-9c84-5e4445f67b63 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:15.332659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074d3f7-e7b4-462d-9c84-5e4445f67b63 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:15.336168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:15.336811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:15.337094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:15.337368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:15.369109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:15.404094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:15.405570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:15.414781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1130/2252] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:16.143247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:16.146246 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:16.164071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610568e-ae17-4444-8938-7c44b7459489 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:16.169034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa40d0e-b328-4890-8c42-235f44377157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:16.171584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40d0e-b328-4890-8c42-235f44377157 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:16.172036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40d0e-b328-4890-8c42-235f44377157 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:16.172508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa40d0e-b328-4890-8c42-235f44377157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:16.207137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa40d0e-b328-4890-8c42-235f44377157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:16.209408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa40d0e-b328-4890-8c42-235f44377157 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:16.223918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1123/2253] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:21.693062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:21.763784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b325-d8d2-40a6-9cc9-092c0b49c8c2 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:21.770642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:21.771289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:21.771564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:21.771834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] PATH_INFO: `/v3/users/768952a6a3c5449f8db42ff6fc614b75` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:21.772999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768952a6a3c5449f8db42ff6fc614b75)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:21.774935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:21.846515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768952a6a3c5449f8db42ff6fc614b75'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:21.848061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768952a6a3c5449f8db42ff6fc614b75'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:21.848981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768952a6a3c5449f8db42ff6fc614b75'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:21.866749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768952a6a3c5449f8db42ff6fc614b75'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:21.875554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768952a6a3c5449f8db42ff6fc614b75'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:21.897110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1131/2254] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:21 2022] DELETE /identity/v3/users/768952a6a3c5449f8db42ff6fc614b75 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:21.901604 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89473-0761-440f-864c-12342d095159 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:21.902090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89473-0761-440f-864c-12342d095159 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:21.902170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89473-0761-440f-864c-12342d095159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:21.921290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-85b89473-0761-440f-864c-12342d095159 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:21.922773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-85b89473-0761-440f-864c-12342d095159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:21.997803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1124/2255] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:57:22.007371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:22.008851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:22.062293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:22.067941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050732-a471-4e8f-9ffc-a1fe45205022 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:22.072451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:22.073068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:22.073352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:22.073630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:22.082765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:22.084187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:22.094011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1132/2256] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:22.359859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89473-0761-440f-864c-12342d095159 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:22.371954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-85b89473-0761-440f-864c-12342d095159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:22.384959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89473-0761-440f-864c-12342d095159 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:22.390551 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:22.392042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:22.392354 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:22.393430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] PATH_INFO: `/v3/projects/0fdb4566efe74fafb5bca0ae6754d6b8` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:22.394891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdb4566efe74fafb5bca0ae6754d6b8)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:22.397473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:22.430395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:22.448468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdb4566efe74fafb5bca0ae6754d6b8', 'request_id': 'req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.454115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdb4566efe74fafb5bca0ae6754d6b8', 'request_id': 'req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.460216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdb4566efe74fafb5bca0ae6754d6b8', 'request_id': 'req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.473085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] The token cache is being invalidate because project 0fdb4566efe74fafb5bca0ae6754d6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:22.473386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.474395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.475970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1125/2257] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:22 2022] DELETE /identity/v3/projects/0fdb4566efe74fafb5bca0ae6754d6b8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:22.479982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:22.491299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db526a-acf5-47d2-b89d-bf605c26dd36 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:22.549928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:22.550635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:22.550925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:22.551209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] PATH_INFO: `/v3/users/734bd9d00d8849e087b7a6c7bd44dbe6` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:22.552450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=734bd9d00d8849e087b7a6c7bd44dbe6)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:22.554381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:22.611060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734bd9d00d8849e087b7a6c7bd44dbe6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.611708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734bd9d00d8849e087b7a6c7bd44dbe6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.612314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734bd9d00d8849e087b7a6c7bd44dbe6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.619830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734bd9d00d8849e087b7a6c7bd44dbe6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.627782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734bd9d00d8849e087b7a6c7bd44dbe6'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:22.658982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1133/2258] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:22 2022] DELETE /identity/v3/users/734bd9d00d8849e087b7a6c7bd44dbe6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:22.939693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:22.941720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:22.958120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17825bc1-c1fe-4945-badb-e11c7c0b1e7f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:23.020230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:23.020894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:23.021175 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:23.021447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] PATH_INFO: `/v3/projects/3e57fe321f0b4c5581006b76f62d7e05` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:23.022578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e57fe321f0b4c5581006b76f62d7e05)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:23.024528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:23.083571 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e57fe321f0b4c5581006b76f62d7e05', 'request_id': 'req-aba395ec-9053-48fa-a0d7-652ba72f4075'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.095224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e57fe321f0b4c5581006b76f62d7e05', 'request_id': 'req-aba395ec-9053-48fa-a0d7-652ba72f4075'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.105205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e57fe321f0b4c5581006b76f62d7e05', 'request_id': 'req-aba395ec-9053-48fa-a0d7-652ba72f4075'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.120987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] The token cache is being invalidate because project 3e57fe321f0b4c5581006b76f62d7e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:23.121272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.121904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.126848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1126/2259] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:22 2022] DELETE /identity/v3/projects/3e57fe321f0b4c5581006b76f62d7e05 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:23.128200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:23.130038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:23.144651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90990f82-a266-4cd6-8856-d0b6ec1ea97d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:23.297639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:23.298355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:23.298629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:23.299373 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] PATH_INFO: `/v3/users/9d6a975ec99d4e748a5903ae810d5cc7` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:23.301313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6a975ec99d4e748a5903ae810d5cc7)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:23.305330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:23.321539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:23.374694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6a975ec99d4e748a5903ae810d5cc7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.375431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6a975ec99d4e748a5903ae810d5cc7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.376065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6a975ec99d4e748a5903ae810d5cc7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.389282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6a975ec99d4e748a5903ae810d5cc7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.404162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b75bfc86-b4cf-4465-afa6-92c84e739a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6a975ec99d4e748a5903ae810d5cc7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.431429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1134/2260] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:23 2022] DELETE /identity/v3/users/9d6a975ec99d4e748a5903ae810d5cc7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:23.740241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:23.742006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:23.761666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba395ec-9053-48fa-a0d7-652ba72f4075 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:23.819278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:23.839290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:23.840262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:23.840495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:23.840879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] PATH_INFO: `/v3/projects/d5813de9a10f4961b5aefe8ac1c08c09` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:23.842188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5813de9a10f4961b5aefe8ac1c08c09)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:23.844627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:23.905080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5813de9a10f4961b5aefe8ac1c08c09', 'request_id': 'req-b4c44798-88ae-4626-b4f1-6bf2c3522720'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.927846 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5813de9a10f4961b5aefe8ac1c08c09', 'request_id': 'req-b4c44798-88ae-4626-b4f1-6bf2c3522720'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.937330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5813de9a10f4961b5aefe8ac1c08c09', 'request_id': 'req-b4c44798-88ae-4626-b4f1-6bf2c3522720'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.961296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] The token cache is being invalidate because project d5813de9a10f4961b5aefe8ac1c08c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:23.962430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.963139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b4c44798-88ae-4626-b4f1-6bf2c3522720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:23.968079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1127/2261] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:23 2022] DELETE /identity/v3/projects/d5813de9a10f4961b5aefe8ac1c08c09 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:23.969899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbca6d-74ad-472b-8e3e-dd5be7edc227 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:23.970192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbca6d-74ad-472b-8e3e-dd5be7edc227 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:23.970475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbca6d-74ad-472b-8e3e-dd5be7edc227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.022384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-80dbca6d-74ad-472b-8e3e-dd5be7edc227 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:24.023941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-80dbca6d-74ad-472b-8e3e-dd5be7edc227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:24.114366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1135/2262] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:24.123244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7ee3-7a6a-4c56-b5f1-3a45515a76ab None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.123529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7ee3-7a6a-4c56-b5f1-3a45515a76ab None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.123800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a7ee3-7a6a-4c56-b5f1-3a45515a76ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.144209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-420a7ee3-7a6a-4c56-b5f1-3a45515a76ab None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:24.148488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-420a7ee3-7a6a-4c56-b5f1-3a45515a76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:24.157045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1128/2263] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:24.161318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbca6d-74ad-472b-8e3e-dd5be7edc227 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:24.171837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbca6d-74ad-472b-8e3e-dd5be7edc227 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:24.176690 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:24.177302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.177665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.177965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.178654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:24.178989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:24.180669 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:24.195410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1136/2264] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:24.199870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7ee3-7a6a-4c56-b5f1-3a45515a76ab None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:24.209486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a7ee3-7a6a-4c56-b5f1-3a45515a76ab None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:24.214276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:24.214890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.215172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.215447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.216612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:24.218535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:24.252400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1129/2265] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:24 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:57:24.256726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:24.267141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181332ea-e421-40f9-8004-552109648fc3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:24.352238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:24.352969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.353325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.353674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.354543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:24.357027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:24.407011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1137/2266] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:24 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:24.411892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:24.444671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dff1bb-e989-4293-84cd-a60fde3e5fd5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:24.452331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:24.453386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.453890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.454650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.456086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:24.458687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:24.471296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1130/2267] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:24.475637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:24.483426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:24.494638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8a1e9-25b5-4811-8da5-3ebedcdc0910 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:24.502047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daedabc-e2b6-4cf1-b296-f0d1d9d233db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:24.502311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedabc-e2b6-4cf1-b296-f0d1d9d233db admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.502654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedabc-e2b6-4cf1-b296-f0d1d9d233db admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.503658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daedabc-e2b6-4cf1-b296-f0d1d9d233db admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.503938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daedabc-e2b6-4cf1-b296-f0d1d9d233db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:24.506135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daedabc-e2b6-4cf1-b296-f0d1d9d233db admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:24.521947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1138/2268] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:57:24.523628 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:24.534134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442abc9-4b13-45ad-9858-cb00bc33cd03 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:24.539319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:24.540184 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.540500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.540781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] PATH_INFO: `/v3/projects/3bb803aa2de34ca2b905e52176607e81/users/0d884a443736416da22bd4b2853e2bfc/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.557362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb803aa2de34ca2b905e52176607e81, user_id=0d884a443736416da22bd4b2853e2bfc, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:24.560305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:24.575924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1131/2269] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:24 2022] PUT /identity/v3/projects/3bb803aa2de34ca2b905e52176607e81/users/0d884a443736416da22bd4b2853e2bfc/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:24.586911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4325-30e7-4076-a9c2-35f131d726eb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.587203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4325-30e7-4076-a9c2-35f131d726eb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.587487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b4325-30e7-4076-a9c2-35f131d726eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.619974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d18b4325-30e7-4076-a9c2-35f131d726eb None None] MFA Rules not processed for user `0d884a443736416da22bd4b2853e2bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:24.621259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d18b4325-30e7-4076-a9c2-35f131d726eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:24.709064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1139/2270] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:24.755780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:24.758415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:24.857481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa55f7-662d-4dfa-a23e-ccb681c898ac admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:24.861746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:24.862520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:24.862804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:24.863082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:24.871780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:24.873929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:24.883620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1132/2271] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:26.094865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868999b-f51b-42b0-8482-8138dac029fe None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:26.095350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868999b-f51b-42b0-8482-8138dac029fe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:26.095463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868999b-f51b-42b0-8482-8138dac029fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:26.122031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9868999b-f51b-42b0-8482-8138dac029fe None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:26.123610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9868999b-f51b-42b0-8482-8138dac029fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:26.188535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1140/2272] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:57:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:26.235869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:26.237642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:26.261392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:26.341589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d36d0-bed1-4f06-a642-0bbf01a907d1 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:26.347216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdcb82-8b09-44a4-9c3f-c479b47e6f7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:26.348240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdcb82-8b09-44a4-9c3f-c479b47e6f7d service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:26.348626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdcb82-8b09-44a4-9c3f-c479b47e6f7d service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:26.349000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdcb82-8b09-44a4-9c3f-c479b47e6f7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:26.361049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdcb82-8b09-44a4-9c3f-c479b47e6f7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:26.363420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdcb82-8b09-44a4-9c3f-c479b47e6f7d service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:26.374141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1133/2273] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:28.397786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:28.398364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:28.398364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:28.417650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] MFA Rules not processed for user `1d6c68a0197548ab91bd66342974dd28`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:28.419488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:28.483119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1141/2274] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:28.494333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205ab52-ac7b-4448-90a0-2bb3a97f59ca None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:28.494918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205ab52-ac7b-4448-90a0-2bb3a97f59ca None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:28.495458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205ab52-ac7b-4448-90a0-2bb3a97f59ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:28.518056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-2205ab52-ac7b-4448-90a0-2bb3a97f59ca None None] MFA Rules not processed for user `f0602554c12e4710912338a9ddccbbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:28.519431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2205ab52-ac7b-4448-90a0-2bb3a97f59ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:28.612508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1134/2275] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:28.883302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:28.885865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:28.942578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:28.986823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c9131-1b3f-4579-b59b-d93a169ad741 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:28.993246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:28.994286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:28.994870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:28.995300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] PATH_INFO: `/v3/users/829f3b906dfc42d584517c630e055d72` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:28.997308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829f3b906dfc42d584517c630e055d72)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:29.000283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:29.084022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829f3b906dfc42d584517c630e055d72'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.084860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829f3b906dfc42d584517c630e055d72'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.085589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829f3b906dfc42d584517c630e055d72'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.106804 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829f3b906dfc42d584517c630e055d72'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.121339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829f3b906dfc42d584517c630e055d72'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.166128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1142/2276] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:28 2022] DELETE /identity/v3/users/829f3b906dfc42d584517c630e055d72 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:29.170672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:29.171916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:29.173045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:29.243055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:29.244367 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:29.399665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:29.401312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:29.417535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6722e-b396-4039-a896-0e9431969c06 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:29.427219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:29.427886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:29.428173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:29.428498 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] PATH_INFO: `/v3/users/5d3fd57892624ff58f30590743d48453` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:29.437316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3fd57892624ff58f30590743d48453)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:29.444372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:29.444522 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1135/2277] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:57:29.444916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:29.449675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:29.543568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3fd57892624ff58f30590743d48453'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.545435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3fd57892624ff58f30590743d48453'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.546066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3fd57892624ff58f30590743d48453'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.555607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3fd57892624ff58f30590743d48453'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.564720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad07873a-4e74-4a10-9a6f-5807b079315a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3fd57892624ff58f30590743d48453'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:29.590770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:29.600486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998df6c4-2a14-465e-a8eb-225ac720aa2a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:29.604272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1143/2278] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:29 2022] DELETE /identity/v3/users/5d3fd57892624ff58f30590743d48453 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:29.607818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:29.607818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:29.608025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:29.608199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:29.611440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:29.611779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:29.613187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:29.614216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:29.638034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:29.641588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:29.643206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:29.647810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:29.669427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:29.681314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1136/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:29.745472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1144/2280] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:29.762372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:29.764751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:29.783542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bcd9b-9c41-46bd-a12a-7a4998249e3f service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:29.907994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:29.908950 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:29.909243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:29.909517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:29.922364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:29.924313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:29.940343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1137/2281] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:30.565882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:30.569165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:30.587061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:30.589587 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:30.603018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6268a2-ce06-4789-81ee-05cdea513f59 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:30.621325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:30.624257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:30.625895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:30.626185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] PATH_INFO: `/v3/projects/8e024e69bcc3461086b9ed58a80c39c6` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:30.629548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e024e69bcc3461086b9ed58a80c39c6)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:30.635703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:30.667916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cf2cf-632c-4272-9d16-cebd6e46acd2 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:30.678325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:30.679862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:30.680706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:30.681475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] PATH_INFO: `/v3/projects/5c00c93d716740038826ae3647061ffa` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:30.683839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c00c93d716740038826ae3647061ffa)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:30.688002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:30.760163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e024e69bcc3461086b9ed58a80c39c6', 'request_id': 'req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.789082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c00c93d716740038826ae3647061ffa', 'request_id': 'req-2f9a019a-98b3-4f08-8866-a7178a45a715'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.789380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e024e69bcc3461086b9ed58a80c39c6', 'request_id': 'req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.796752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c00c93d716740038826ae3647061ffa', 'request_id': 'req-2f9a019a-98b3-4f08-8866-a7178a45a715'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.810702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c00c93d716740038826ae3647061ffa', 'request_id': 'req-2f9a019a-98b3-4f08-8866-a7178a45a715'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.816948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e024e69bcc3461086b9ed58a80c39c6', 'request_id': 'req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.839424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] The token cache is being invalidate because project 5c00c93d716740038826ae3647061ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:30.840143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.841658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2f9a019a-98b3-4f08-8866-a7178a45a715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.846265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1138/2282] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:30 2022] DELETE /identity/v3/projects/5c00c93d716740038826ae3647061ffa => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:30.852136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576affa6-bd00-4243-8e9e-51976fde51e4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:30.852625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576affa6-bd00-4243-8e9e-51976fde51e4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:30.853115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576affa6-bd00-4243-8e9e-51976fde51e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:30.877273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] The token cache is being invalidate because project 8e024e69bcc3461086b9ed58a80c39c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:30.877602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.878332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:30.884027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1145/2283] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:30 2022] DELETE /identity/v3/projects/8e024e69bcc3461086b9ed58a80c39c6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:30.885187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:30.897388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:30.947574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-576affa6-bd00-4243-8e9e-51976fde51e4 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:30.957164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-576affa6-bd00-4243-8e9e-51976fde51e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:31.085720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da56c27-a76f-4dcb-bf2d-2caf4ea9329c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:31.191061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1139/2284] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:31.201449 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17c2e-e94e-44bb-8641-b4f32ef066af None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:31.201780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17c2e-e94e-44bb-8641-b4f32ef066af None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:31.202475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17c2e-e94e-44bb-8641-b4f32ef066af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:31.232633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:31.253123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:31.254060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:31.254508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:31.254950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] PATH_INFO: `/v3/users/16d9c931fde14a62aa2d06f0ce53b233` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:31.256273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d9c931fde14a62aa2d06f0ce53b233)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:31.257731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6ed17c2e-e94e-44bb-8641-b4f32ef066af None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:31.258638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:31.260941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6ed17c2e-e94e-44bb-8641-b4f32ef066af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:31.318304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1140/2285] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:57:31.324242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed17c2e-e94e-44bb-8641-b4f32ef066af None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:31.364098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed17c2e-e94e-44bb-8641-b4f32ef066af None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:31.402504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:31.409792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:31.410037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:31.410384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:31.411048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:31.411387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:31.415593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:31.436811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d9c931fde14a62aa2d06f0ce53b233'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:31.438268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d9c931fde14a62aa2d06f0ce53b233'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:31.439289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d9c931fde14a62aa2d06f0ce53b233'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:31.453697 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:31.456900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d9c931fde14a62aa2d06f0ce53b233'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:31.473553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d9c931fde14a62aa2d06f0ce53b233'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:31.487902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1141/2286] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:31.488983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:31.490780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:31.519588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9dfef-38b1-43d2-899a-11e1b53a8cc1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:31.529015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1146/2287] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:30 2022] DELETE /identity/v3/users/16d9c931fde14a62aa2d06f0ce53b233 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:31.541227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:31.541871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:31.542179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:31.542436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:31.543072 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:31.545104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:31.631325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1142/2288] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:31 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:57:31.635841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:31.774007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e00c-363e-4984-9b83-1b72a1a68e7c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:31.926762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:31.930187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:31.930511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:31.931763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:31.932477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:31.939008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:31.991306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1147/2289] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:31 2022] POST /identity/v3/users => generated 287 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:31.995639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.014904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77197b3d-4a0a-42bb-be46-2eea10d50790 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.030929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.031566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.031849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.032124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.032832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.034470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.060786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1143/2290] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:32.066574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.080557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011c0fd-8d56-4eee-b719-1a90f446a1e7 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.086609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.087902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.088190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.088473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.088765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.089530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.090569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:32.094785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.113658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce58895-2603-4445-b028-8b39c1e63311 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.134191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.135285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.135713 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.136070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] PATH_INFO: `/v3/projects/abc087a832534c40ab3aa787661033b6` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.139448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:32.140719 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc087a832534c40ab3aa787661033b6)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.147050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.150440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1148/2291] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:32.151626 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.207443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa373f2-c019-4378-b967-cf7f4c14c3a6 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.235790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940299ab-65d5-49ff-8c98-e62370b055ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.238687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940299ab-65d5-49ff-8c98-e62370b055ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.239099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940299ab-65d5-49ff-8c98-e62370b055ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.241327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940299ab-65d5-49ff-8c98-e62370b055ce admin admin] PATH_INFO: `/v3/projects/aefe2e4ebfa847e789dc21fb59d51eb0/users/c5f2aed8baf349a1b4f5fe6219eb2669/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.318305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc087a832534c40ab3aa787661033b6', 'request_id': 'req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.323454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940299ab-65d5-49ff-8c98-e62370b055ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefe2e4ebfa847e789dc21fb59d51eb0, user_id=c5f2aed8baf349a1b4f5fe6219eb2669, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.334904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940299ab-65d5-49ff-8c98-e62370b055ce admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.357481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc087a832534c40ab3aa787661033b6', 'request_id': 'req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.373576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc087a832534c40ab3aa787661033b6', 'request_id': 'req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.389276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1149/2292] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:32 2022] PUT /identity/v3/projects/aefe2e4ebfa847e789dc21fb59d51eb0/users/c5f2aed8baf349a1b4f5fe6219eb2669/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:32.400990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.401292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.401668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.405975 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] The token cache is being invalidate because project abc087a832534c40ab3aa787661033b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:32.406324 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.407606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e0960e4d-b7f5-4c6a-a83c-52ec2f0f137e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.412432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1144/2293] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:32 2022] DELETE /identity/v3/projects/abc087a832534c40ab3aa787661033b6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:57:32.417135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80597942-1996-4b3e-95b6-4ea979502273 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.417966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80597942-1996-4b3e-95b6-4ea979502273 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.419151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80597942-1996-4b3e-95b6-4ea979502273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.461143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-80597942-1996-4b3e-95b6-4ea979502273 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:32.462639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-80597942-1996-4b3e-95b6-4ea979502273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:32.473840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] MFA Rules not processed for user `c5f2aed8baf349a1b4f5fe6219eb2669`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:32.476166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:32.560492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1150/2294] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:32.585071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.587125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:32.633387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1145/2295] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:32.647194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646bf84-e2cd-454f-b6a0-441b01012738 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.647510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646bf84-e2cd-454f-b6a0-441b01012738 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.648060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646bf84-e2cd-454f-b6a0-441b01012738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.687446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-8646bf84-e2cd-454f-b6a0-441b01012738 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:32.688717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-8646bf84-e2cd-454f-b6a0-441b01012738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:32.703064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1146/2296] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:32.703735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd3dd9-ea8f-4336-a439-fd22c1370ebf None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.704688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646bf84-e2cd-454f-b6a0-441b01012738 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.718292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.719456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.719760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.720128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.720770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646bf84-e2cd-454f-b6a0-441b01012738 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.734276 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.737818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.740859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.742254 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.742548 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.742829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.743503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:32.743815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.745540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.765212 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1151/2297] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:57:32.798358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1147/2298] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:32.801126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.818499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.820303 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:32.822737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feae27e-c525-490e-8c8a-7dbc81f15635 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.835804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd609ed-908c-47ec-ac9a-d3a46de65f97 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:32.841976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.842837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.843296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.843934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] PATH_INFO: `/v3/users/c5f2aed8baf349a1b4f5fe6219eb2669` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.845295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f2aed8baf349a1b4f5fe6219eb2669)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.847627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.848206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:32.849102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:32.849488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:32.849862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:32.850733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:32.853288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:32.892987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:32.902088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1152/2299] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:32 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:32.929378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:32.935588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f2aed8baf349a1b4f5fe6219eb2669'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.937419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f2aed8baf349a1b4f5fe6219eb2669'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.959235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f2aed8baf349a1b4f5fe6219eb2669'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.960680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f2aed8baf349a1b4f5fe6219eb2669'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:32.970832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a48d6d92-02d5-4664-ac69-ff4a5ffb0d69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f2aed8baf349a1b4f5fe6219eb2669'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:33.002124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1148/2300] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:32 2022] DELETE /identity/v3/users/c5f2aed8baf349a1b4f5fe6219eb2669 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:33.003744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.004136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.004559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.026923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:33.029146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:33.032770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:33.051943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e72357-d841-4d05-96d5-f30d7b3f5a10 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:33.138042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:33.138666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.138952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.139277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.139922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:33.142284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:33.155433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1149/2301] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:57:33.167856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:33.171064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:33.188227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1153/2302] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:32 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:33.192011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:33.195710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:33.218377 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d670b-9ec6-45c8-a031-0243a021dd95 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:33.224853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:33.225601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.225979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.226347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.227100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:33.228867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:33.241119 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1154/2303] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:33.246041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:33.266482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a490b0-c1ed-433c-9501-5e39f56737a2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:33.277437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d5983-cce9-4aee-8888-c2ec767a2005 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:33.279328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41e696-15f7-457e-a468-20b920dcfa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:33.282838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e696-15f7-457e-a468-20b920dcfa01 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.283980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:33.285122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.285323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e696-15f7-457e-a468-20b920dcfa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.285724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e696-15f7-457e-a468-20b920dcfa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.285875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.286286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.287290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41e696-15f7-457e-a468-20b920dcfa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:33.293018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41e696-15f7-457e-a468-20b920dcfa01 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:33.303516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:33.306212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:33.323612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1150/2304] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:33.339010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1155/2305] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:33.342416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:33.360843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6ed07-a5e1-499f-b77f-f76bf1b77c72 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:33.366446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:33.367590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.367878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.368158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] PATH_INFO: `/v3/projects/8d651240d1e64aa797c48c885c02e76c/users/32e412aface240d59f3abfe99dce5d8e/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.391498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d651240d1e64aa797c48c885c02e76c, user_id=32e412aface240d59f3abfe99dce5d8e, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:33.398462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:33.436446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1151/2306] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:33 2022] PUT /identity/v3/projects/8d651240d1e64aa797c48c885c02e76c/users/32e412aface240d59f3abfe99dce5d8e/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:57:33.442444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.442736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.443013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.528851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] MFA Rules not processed for user `32e412aface240d59f3abfe99dce5d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:33.531514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:33.703477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1156/2307] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:33.708144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:33.741106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:33.803406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:33.806405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:33.822586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a99ba-8607-44ee-bad8-1f6761465113 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:33.834676 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:33.836520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:33.836978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:33.837802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:33.841022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:33.848369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:33.918991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1152/2308] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:33 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:33.919924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:33.952981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:33.984132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948214d-0715-407a-a9ee-81e8a1d9e60e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:34.056918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83559653-413d-4701-940a-bb04e2510048 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:34.072297 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:34.073053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.073362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.073677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.074408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:34.076666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:34.112576 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:34.113567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.115861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.116203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] PATH_INFO: `/v3/projects/aefe2e4ebfa847e789dc21fb59d51eb0` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.117816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefe2e4ebfa847e789dc21fb59d51eb0)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:34.122074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1153/2309] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:33 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:34.122565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:34.126446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:34.146530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d013-3f9e-47dc-9e06-9c478561ade8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:34.152556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:34.153365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.153752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.155665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.156669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:34.158507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:34.187239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1154/2310] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:34.188758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:34.201760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea238-deaf-48a9-a9c1-b3c039e72207 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:34.245215 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefe2e4ebfa847e789dc21fb59d51eb0', 'request_id': 'req-eb7db886-667d-401a-aac4-c97ebedcc2d0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:34.256705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefe2e4ebfa847e789dc21fb59d51eb0', 'request_id': 'req-eb7db886-667d-401a-aac4-c97ebedcc2d0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:34.275811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefe2e4ebfa847e789dc21fb59d51eb0', 'request_id': 'req-eb7db886-667d-401a-aac4-c97ebedcc2d0'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:34.295087 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] The token cache is being invalidate because project aefe2e4ebfa847e789dc21fb59d51eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:34.295758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:34.296856 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:34.299012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1157/2311] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:33 2022] DELETE /identity/v3/projects/aefe2e4ebfa847e789dc21fb59d51eb0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:34.308738 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:34.310679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.312482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.312892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] PATH_INFO: `/v3/projects/ee3e2b5901f1443bb0c8e6a7df5d520a/users/3b0d11e355fd48a38907443d0f6bb785/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.337417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3e2b5901f1443bb0c8e6a7df5d520a, user_id=3b0d11e355fd48a38907443d0f6bb785, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:34.344145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:34.368961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1155/2312] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:34 2022] PUT /identity/v3/projects/ee3e2b5901f1443bb0c8e6a7df5d520a/users/3b0d11e355fd48a38907443d0f6bb785/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:34.370238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:34.378063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:34.397342 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7db886-667d-401a-aac4-c97ebedcc2d0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:34.469665 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6e176-392c-4ec4-944e-d13ed1e88819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:34.470158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e176-392c-4ec4-944e-d13ed1e88819 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.470547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e176-392c-4ec4-944e-d13ed1e88819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.470894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6e176-392c-4ec4-944e-d13ed1e88819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.471656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6e176-392c-4ec4-944e-d13ed1e88819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:34.473420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6e176-392c-4ec4-944e-d13ed1e88819 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:34.485694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1158/2313] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:34.489550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:34.504048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255dcd4-a0ae-4acc-9a42-95dd7393f198 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:34.512178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:34.514140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.514140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.514350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] PATH_INFO: `/v3/projects/ee3e2b5901f1443bb0c8e6a7df5d520a/users/3b0d11e355fd48a38907443d0f6bb785/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.517332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3e2b5901f1443bb0c8e6a7df5d520a, user_id=3b0d11e355fd48a38907443d0f6bb785, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:34.522462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:34.553647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1156/2314] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:34 2022] PUT /identity/v3/projects/ee3e2b5901f1443bb0c8e6a7df5d520a/users/3b0d11e355fd48a38907443d0f6bb785/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:34.554093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:34.570525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b22c7-14a8-4d4b-a35b-6339fb563bce None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.571123 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b22c7-14a8-4d4b-a35b-6339fb563bce None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.571841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b22c7-14a8-4d4b-a35b-6339fb563bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.625105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-563b22c7-14a8-4d4b-a35b-6339fb563bce None None] MFA Rules not processed for user `3b0d11e355fd48a38907443d0f6bb785`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:34.633028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-563b22c7-14a8-4d4b-a35b-6339fb563bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:34.655698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:34.791488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1159/2315] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:34.810168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:34.823726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:34.961645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bfb5e-b400-47e6-957a-3d8021a50805 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:34.965899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:34.966647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:34.967236 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:34.967795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:34.982076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:34.983700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:34.998343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1157/2316] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:35.636180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b22c7-14a8-4d4b-a35b-6339fb563bce None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:35.646668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b22c7-14a8-4d4b-a35b-6339fb563bce None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:35.661489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0d11e355fd48a38907443d0f6bb785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee3e2b5901f1443bb0c8e6a7df5d520a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:35.662132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:35.662424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:35.662706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:35.663382 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:35.663697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:35.672083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:35.722196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:35.728199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1160/2317] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:35.732847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f48476-5b07-4c72-be8b-4563658d053f service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:35.745983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0d11e355fd48a38907443d0f6bb785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee3e2b5901f1443bb0c8e6a7df5d520a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:35.749419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:35.752215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:35.752737 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:35.755265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:35.759502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:35.850517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1158/2318] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:35 2022] POST /identity/v3/projects => generated 353 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:35.853346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:35.866170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d3ba3-cb6d-41b9-a9cb-76b4278d520a tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:35.937012 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0d11e355fd48a38907443d0f6bb785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee3e2b5901f1443bb0c8e6a7df5d520a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:35.938066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:35.939535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:35.940041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:35.941156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:35.941816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:35.946586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:35.969574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1161/2319] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:36.051391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:36.063106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140ffba-284f-460d-87b6-d80cd6c6b6b7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:36.069539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b0d11e355fd48a38907443d0f6bb785', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee3e2b5901f1443bb0c8e6a7df5d520a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:36.070797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:36.071139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:36.071564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] PATH_INFO: `/v3/projects/e864d54069c34fdc9d8a1261ec424db5` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:36.073421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e864d54069c34fdc9d8a1261ec424db5)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:36.077113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:36.148875 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e864d54069c34fdc9d8a1261ec424db5', 'request_id': 'req-6854438e-f277-4f4b-9219-0f050d7fb4e7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.162136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e864d54069c34fdc9d8a1261ec424db5', 'request_id': 'req-6854438e-f277-4f4b-9219-0f050d7fb4e7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.173984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e864d54069c34fdc9d8a1261ec424db5', 'request_id': 'req-6854438e-f277-4f4b-9219-0f050d7fb4e7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.200017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] The token cache is being invalidate because project e864d54069c34fdc9d8a1261ec424db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:36.200301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.201187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.206733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1159/2320] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:36 2022] DELETE /identity/v3/projects/e864d54069c34fdc9d8a1261ec424db5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:36.528138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:36.529945 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:36.703511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb23dea-4ced-458e-85aa-b4099a0840f4 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:36.788043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:36.844429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:36.845194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:36.845557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:36.845913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] PATH_INFO: `/v3/users/32e412aface240d59f3abfe99dce5d8e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:36.848024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e412aface240d59f3abfe99dce5d8e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:36.852439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:36.885326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:36.886814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:36.918863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854438e-f277-4f4b-9219-0f050d7fb4e7 tempest-VolumeQuotaClassesTest-1553377426 tempest-VolumeQuotaClassesTest-1553377426-project-admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:36.935531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:36.936997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:36.937353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:36.937928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] PATH_INFO: `/v3/users/0d884a443736416da22bd4b2853e2bfc` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:36.940237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d884a443736416da22bd4b2853e2bfc)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:36.944026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:36.957580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e412aface240d59f3abfe99dce5d8e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.960426 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e412aface240d59f3abfe99dce5d8e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.961267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e412aface240d59f3abfe99dce5d8e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.979685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e412aface240d59f3abfe99dce5d8e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:36.997827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6957d16b-2f7b-4f6a-85c7-6500585efd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e412aface240d59f3abfe99dce5d8e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:37.019531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d884a443736416da22bd4b2853e2bfc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:37.020425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d884a443736416da22bd4b2853e2bfc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:37.028372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:INSERT=3,keystone:SELECT=83,keystone:DELETE=14 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:37.036268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d884a443736416da22bd4b2853e2bfc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:37.037371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d884a443736416da22bd4b2853e2bfc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:37.038581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1162/2321] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:36 2022] DELETE /identity/v3/users/32e412aface240d59f3abfe99dce5d8e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:37.048673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d602b6-12d1-416c-85a5-a72523c1c0df None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:37.049060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d602b6-12d1-416c-85a5-a72523c1c0df None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:37.049232 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d602b6-12d1-416c-85a5-a72523c1c0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:37.052520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-93c21feb-caeb-472c-9511-eaedf68f29a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d884a443736416da22bd4b2853e2bfc'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:37.089305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f7d602b6-12d1-416c-85a5-a72523c1c0df None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:37.091286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f7d602b6-12d1-416c-85a5-a72523c1c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:37.092835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1160/2322] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:36 2022] DELETE /identity/v3/users/0d884a443736416da22bd4b2853e2bfc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:37.103882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:37.104462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:37.104815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:37.148306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:37.149701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:37.240871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1163/2323] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:37.244299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2697d-657e-4f7a-8726-660b1a161a75 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:37.244948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2697d-657e-4f7a-8726-660b1a161a75 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:37.244948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2697d-657e-4f7a-8726-660b1a161a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:37.278473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1161/2324] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:57:37.282437 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:37.287073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:37.297227 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-eee2697d-657e-4f7a-8726-660b1a161a75 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:37.299633 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-eee2697d-657e-4f7a-8726-660b1a161a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:37.424707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2e866-ebfd-44b5-86a4-7a7b742d8d3b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:37.425884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1164/2325] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:37.428656 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2697d-657e-4f7a-8726-660b1a161a75 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:37.431985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:37.433329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:37.434535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:37.434785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:37.435570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:37.448060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2697d-657e-4f7a-8726-660b1a161a75 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:37.453744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:37.454988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:37.455812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:37.456210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:37.461910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:37.463717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:37.468000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:37.469468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:37.497583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1162/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:37.499294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1165/2327] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:37.501298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:37.505140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:37.698866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c67992-4688-418c-8d66-d10f5a318c1a service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:37.711360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28316c3e-d526-46d6-8787-56bd8c847eef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:37.712915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28316c3e-d526-46d6-8787-56bd8c847eef service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:37.713356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28316c3e-d526-46d6-8787-56bd8c847eef service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:37.714414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28316c3e-d526-46d6-8787-56bd8c847eef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:37.727411 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28316c3e-d526-46d6-8787-56bd8c847eef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:37.736805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28316c3e-d526-46d6-8787-56bd8c847eef service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:37.748560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1163/2328] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:57:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:57:38.147590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:38.150178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:38.211347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811dcc5-a44c-4cea-8c98-48b087e335c4 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:38.236911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:38.238009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:38.238200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:38.238455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] PATH_INFO: `/v3/projects/3bb803aa2de34ca2b905e52176607e81` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:38.239644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb803aa2de34ca2b905e52176607e81)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:38.241628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:38.306456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb803aa2de34ca2b905e52176607e81', 'request_id': 'req-cd7c4eae-8a71-4713-a3aa-e748dc716564'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.315015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb803aa2de34ca2b905e52176607e81', 'request_id': 'req-cd7c4eae-8a71-4713-a3aa-e748dc716564'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.325893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb803aa2de34ca2b905e52176607e81', 'request_id': 'req-cd7c4eae-8a71-4713-a3aa-e748dc716564'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.345046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] The token cache is being invalidate because project 3bb803aa2de34ca2b905e52176607e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:38.345345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.346678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-cd7c4eae-8a71-4713-a3aa-e748dc716564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.353834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1166/2329] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:38 2022] DELETE /identity/v3/projects/3bb803aa2de34ca2b905e52176607e81 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:57:38.355010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:38.355503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:38.355587 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:38.365553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:38.397149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:38.404203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:38.567472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1164/2330] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:38.575493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b83d-bf3a-4e57-bbde-6dd1afd5f908 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:38.575807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b83d-bf3a-4e57-bbde-6dd1afd5f908 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:38.576058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49b83d-bf3a-4e57-bbde-6dd1afd5f908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:38.625681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:38.627397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:38.646311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9f49b83d-bf3a-4e57-bbde-6dd1afd5f908 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:38.653497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ba0c-79ae-4e3d-8298-6f0c2332d691 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:38.654682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9f49b83d-bf3a-4e57-bbde-6dd1afd5f908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:38.672592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:38.673547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:38.676288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:38.676842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] PATH_INFO: `/v3/projects/8d651240d1e64aa797c48c885c02e76c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:38.685946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d651240d1e64aa797c48c885c02e76c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:38.690889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:38.695631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1167/2331] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:38.699591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49b83d-bf3a-4e57-bbde-6dd1afd5f908 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:38.726188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49b83d-bf3a-4e57-bbde-6dd1afd5f908 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:38.750684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:38.751481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:38.751864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:38.752563 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:38.753366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:38.754116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:38.759596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:38.818337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1168/2332] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:38.823895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:38.824803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d651240d1e64aa797c48c885c02e76c', 'request_id': 'req-03867754-2080-4f3a-bc2c-d4175ad8be6f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.839073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d651240d1e64aa797c48c885c02e76c', 'request_id': 'req-03867754-2080-4f3a-bc2c-d4175ad8be6f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.852904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d651240d1e64aa797c48c885c02e76c', 'request_id': 'req-03867754-2080-4f3a-bc2c-d4175ad8be6f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.860460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fa5c7-b365-4a22-b918-d4c5bcebf414 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:38.881223 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] The token cache is being invalidate because project 8d651240d1e64aa797c48c885c02e76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:38.883094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.884088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:38.895423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1165/2333] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:38 2022] DELETE /identity/v3/projects/8d651240d1e64aa797c48c885c02e76c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:57:38.896742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:38.904327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:39.005041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:39.005676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:39.005965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:39.006416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:39.007587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:39.009855 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:39.077574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1169/2334] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:38 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:57:39.081570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:39.086344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:39.124312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03867754-2080-4f3a-bc2c-d4175ad8be6f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:39.216562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:39.236868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:39.293738 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:39.294592 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:39.294978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:39.295362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] PATH_INFO: `/v3/users/3b0d11e355fd48a38907443d0f6bb785` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:39.297418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0d11e355fd48a38907443d0f6bb785)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:39.299498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:39.312419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c552cc8-79b3-49bd-95c6-610adf53f97f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:39.325702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:39.326603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:39.327031 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:39.327439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:39.328254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:39.330346 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:39.380973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1170/2335] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:39 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:57:39.383797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:39.395636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456ee90-8043-49df-824d-33067a0e3fc7 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:39.412646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:39.413277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:39.413560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:39.413833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:39.414491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:39.416098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:39.428928 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0d11e355fd48a38907443d0f6bb785'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:39.430512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0d11e355fd48a38907443d0f6bb785'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:39.437546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1171/2336] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:57:39.441421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0d11e355fd48a38907443d0f6bb785'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:39.441570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:39.442529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0d11e355fd48a38907443d0f6bb785'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:39.461005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174839b9-3be0-4c12-8534-80a95c34c0ef admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:39.464648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0d11e355fd48a38907443d0f6bb785'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:39.475931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36531c2-4ca0-4af3-99db-790cd8fcbe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:39.476592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36531c2-4ca0-4af3-99db-790cd8fcbe91 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:39.476876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36531c2-4ca0-4af3-99db-790cd8fcbe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:39.478247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36531c2-4ca0-4af3-99db-790cd8fcbe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:39.479071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36531c2-4ca0-4af3-99db-790cd8fcbe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:39.483908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36531c2-4ca0-4af3-99db-790cd8fcbe91 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:39.501122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1166/2337] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:38 2022] DELETE /identity/v3/users/3b0d11e355fd48a38907443d0f6bb785 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:39.507353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1172/2338] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:39.512702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:39.514458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:39.696806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982252d-6e5e-49a6-9495-324fb4cbef6a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:39.723694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:39.724416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:39.727677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:39.728078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] PATH_INFO: `/v3/projects/29c82b31ed264ecda4c4357f1de1ff91/users/7c9b0cd44552494495aac989af4ac72e/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:39.801907 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c82b31ed264ecda4c4357f1de1ff91, user_id=7c9b0cd44552494495aac989af4ac72e, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:39.804987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:39.860272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1167/2339] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:39 2022] PUT /identity/v3/projects/29c82b31ed264ecda4c4357f1de1ff91/users/7c9b0cd44552494495aac989af4ac72e/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:39.861910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:39.862210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:39.862794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:39.911144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:39.913628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:40.109061 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1173/2340] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:40.119767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:40.122143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:40.209222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:40.220091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:40.221785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:40.251039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ccfa2f-91cf-4e73-acda-aa922603435d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:40.267250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:40.269266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:40.269779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:40.270971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] PATH_INFO: `/v3/projects/ee3e2b5901f1443bb0c8e6a7df5d520a` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:40.272189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1618d-16c7-4783-b442-a722ca7a78da admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:40.273575 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3e2b5901f1443bb0c8e6a7df5d520a)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:40.277906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:40.283104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91083e3a-f051-4dde-89ed-c7be8a80d555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:40.283872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91083e3a-f051-4dde-89ed-c7be8a80d555 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:40.284292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91083e3a-f051-4dde-89ed-c7be8a80d555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:40.286211 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91083e3a-f051-4dde-89ed-c7be8a80d555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:40.306908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91083e3a-f051-4dde-89ed-c7be8a80d555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:40.310165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91083e3a-f051-4dde-89ed-c7be8a80d555 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:40.333567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1168/2341] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:40.400601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3e2b5901f1443bb0c8e6a7df5d520a', 'request_id': 'req-87f233d3-a177-444a-94a0-63fc68bc08cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:40.415327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3e2b5901f1443bb0c8e6a7df5d520a', 'request_id': 'req-87f233d3-a177-444a-94a0-63fc68bc08cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:40.432205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3e2b5901f1443bb0c8e6a7df5d520a', 'request_id': 'req-87f233d3-a177-444a-94a0-63fc68bc08cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:40.457177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] The token cache is being invalidate because project ee3e2b5901f1443bb0c8e6a7df5d520a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:40.458477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:40.461369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-87f233d3-a177-444a-94a0-63fc68bc08cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:40.466204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1174/2342] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:40 2022] DELETE /identity/v3/projects/ee3e2b5901f1443bb0c8e6a7df5d520a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:40.471807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f12c-19e3-47b1-954e-39846b197d7f None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:40.472327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f12c-19e3-47b1-954e-39846b197d7f None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:40.472611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70f12c-19e3-47b1-954e-39846b197d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:40.514406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fe70f12c-19e3-47b1-954e-39846b197d7f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:40.516101 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fe70f12c-19e3-47b1-954e-39846b197d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:40.672054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1169/2343] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:40.680538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269965e0-c16f-4fd8-8b72-043d027a9fe1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:40.681097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269965e0-c16f-4fd8-8b72-043d027a9fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:40.681827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269965e0-c16f-4fd8-8b72-043d027a9fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:40.752198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-269965e0-c16f-4fd8-8b72-043d027a9fe1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:40.753636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-269965e0-c16f-4fd8-8b72-043d027a9fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:40.763692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1175/2344] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:40.767809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f12c-19e3-47b1-954e-39846b197d7f None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:40.782420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70f12c-19e3-47b1-954e-39846b197d7f None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:40.794578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:40.795613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:40.795897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:40.796170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:40.797714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:40.797935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:40.801487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:40.834055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1170/2345] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:40.838409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269965e0-c16f-4fd8-8b72-043d027a9fe1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:40.864614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269965e0-c16f-4fd8-8b72-043d027a9fe1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:40.872930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:40.873571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:40.873854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:40.874131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:40.874775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:40.878030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:40.911952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:40.936205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1176/2346] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:40 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:40.937859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:40.955606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68317a-a1f1-4142-a4fd-96055c720660 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:41.121827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:41.123142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:41.125330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:41.128353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:41.129245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:41.131349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:41.179679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1171/2347] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:40 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:41.183956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:41.211560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34256e-3f90-4ec2-8afb-0fc531bd6f97 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:41.254577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:41.256400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:41.260886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:41.262768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:41.264840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:41.286468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:41.408259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1177/2348] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:41.452346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:41.486235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508f880-a124-4a8c-bd91-337a26c399b8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:41.500193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff74f1-c29e-47fc-b489-ab651ade6d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:41.501286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff74f1-c29e-47fc-b489-ab651ade6d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:41.501593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff74f1-c29e-47fc-b489-ab651ade6d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:41.501884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff74f1-c29e-47fc-b489-ab651ade6d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:41.502614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff74f1-c29e-47fc-b489-ab651ade6d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:41.508528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff74f1-c29e-47fc-b489-ab651ade6d0f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:41.537159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:41.543523 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1172/2349] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:41.557569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf4af-8645-4b9f-94b4-6804f30614a8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:41.564547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:41.565582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:41.565582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:41.565807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] PATH_INFO: `/v3/projects/85216d07fb7d4220951fb8f583985514/users/079d6c51d7b844ffaa68ff6576c5c08c/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:41.595093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85216d07fb7d4220951fb8f583985514, user_id=079d6c51d7b844ffaa68ff6576c5c08c, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:41.597905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:41.643135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1178/2350] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:41 2022] PUT /identity/v3/projects/85216d07fb7d4220951fb8f583985514/users/079d6c51d7b844ffaa68ff6576c5c08c/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:41.649623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb07792-08c0-4c5c-bac7-9eec7ba4a35e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:41.650851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb07792-08c0-4c5c-bac7-9eec7ba4a35e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:41.651378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb07792-08c0-4c5c-bac7-9eec7ba4a35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:41.726106 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ccb07792-08c0-4c5c-bac7-9eec7ba4a35e None None] MFA Rules not processed for user `079d6c51d7b844ffaa68ff6576c5c08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:41.729752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ccb07792-08c0-4c5c-bac7-9eec7ba4a35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:41.830691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:41.927648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1173/2351] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:41.932134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:42.172597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc75d-d418-4f6a-9596-5adb1ce022cd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:42.196248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:42.197071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:42.197474 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:42.199871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:42.200750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:42.207244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:42.304147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb07792-08c0-4c5c-bac7-9eec7ba4a35e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:42.304908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1179/2352] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:41 2022] POST /identity/v3/projects => generated 381 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:42.318294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb07792-08c0-4c5c-bac7-9eec7ba4a35e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:42.461328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:42.477036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:42.477392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:42.477597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:42.478275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:42.480478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:42.544798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1174/2353] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:42 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:42.549348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:42.583206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a283ae-335c-449b-bb9a-cbb0022a9e68 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:42.619975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:42.622295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:42.626786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:42.630344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:42.640706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:42.650113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:42.694741 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1180/2354] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:42.696247 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:42.713371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a5f5f-6930-42a0-aa37-b46cb9ce6de0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:42.735879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:42.738853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:42.741532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:42.742820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] PATH_INFO: `/v3/projects/4a4d01af21e74142b78a4403ecba9eb3/users/7ab1a78beb4e42999cc8a2ae3bf2ab9d/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:42.828198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4d01af21e74142b78a4403ecba9eb3, user_id=7ab1a78beb4e42999cc8a2ae3bf2ab9d, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:42.833036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:42.887847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1175/2355] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:42 2022] PUT /identity/v3/projects/4a4d01af21e74142b78a4403ecba9eb3/users/7ab1a78beb4e42999cc8a2ae3bf2ab9d/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:42.893554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:42.916401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc933-3ed9-4fcc-af27-0cbc40bf876c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:43.056465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9fac7-3c2a-468f-81db-ac2891b37bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:43.057277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9fac7-3c2a-468f-81db-ac2891b37bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:43.057673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9fac7-3c2a-468f-81db-ac2891b37bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:43.058151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9fac7-3c2a-468f-81db-ac2891b37bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:43.058922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9fac7-3c2a-468f-81db-ac2891b37bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:43.060799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9fac7-3c2a-468f-81db-ac2891b37bfb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:43.094068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1181/2356] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:43.098501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:43.115213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e360c6-02a2-4e4d-a723-b33e7222aa32 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:43.140508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:43.141412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:43.141805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:43.142214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] PATH_INFO: `/v3/projects/4a4d01af21e74142b78a4403ecba9eb3/users/7ab1a78beb4e42999cc8a2ae3bf2ab9d/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:43.150555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4d01af21e74142b78a4403ecba9eb3, user_id=7ab1a78beb4e42999cc8a2ae3bf2ab9d, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:43.153514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:43.180946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1176/2357] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:43 2022] PUT /identity/v3/projects/4a4d01af21e74142b78a4403ecba9eb3/users/7ab1a78beb4e42999cc8a2ae3bf2ab9d/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:43.194224 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affd63-3531-4494-887f-c57cd0fe4ebe None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:43.194705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affd63-3531-4494-887f-c57cd0fe4ebe None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:43.195131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3affd63-3531-4494-887f-c57cd0fe4ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:43.275468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f3affd63-3531-4494-887f-c57cd0fe4ebe None None] MFA Rules not processed for user `7ab1a78beb4e42999cc8a2ae3bf2ab9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:43.277599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f3affd63-3531-4494-887f-c57cd0fe4ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:43.342438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:43.488579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1182/2358] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:43.502678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:43.505322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:43.686707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16593b-04c8-40b5-811a-667af74e1291 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:43.699736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:43.700413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:43.700742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:43.701243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:43.711906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:43.721627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:43.736303 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1177/2359] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:44.014985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3affd63-3531-4494-887f-c57cd0fe4ebe None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:44.028744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3affd63-3531-4494-887f-c57cd0fe4ebe None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:44.041201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec3a9e-6e0e-47d0-9ebd-6246690adbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:44.042039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec3a9e-6e0e-47d0-9ebd-6246690adbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:44.043139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec3a9e-6e0e-47d0-9ebd-6246690adbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:44.043562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec3a9e-6e0e-47d0-9ebd-6246690adbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:44.206453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec3a9e-6e0e-47d0-9ebd-6246690adbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:44.208082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec3a9e-6e0e-47d0-9ebd-6246690adbb5 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:44.231759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1183/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:44.848074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:44.987589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:45.080784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c5f8c-b492-401d-86b4-d8daedb193de service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:45.096972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:45.097906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:45.098353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:45.098781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] PATH_INFO: `/v3/users/079d6c51d7b844ffaa68ff6576c5c08c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:45.101001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=079d6c51d7b844ffaa68ff6576c5c08c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:45.103146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:45.233623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079d6c51d7b844ffaa68ff6576c5c08c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:45.234377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079d6c51d7b844ffaa68ff6576c5c08c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:45.253871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079d6c51d7b844ffaa68ff6576c5c08c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:45.257128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079d6c51d7b844ffaa68ff6576c5c08c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:45.270446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079d6c51d7b844ffaa68ff6576c5c08c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:45.306712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1178/2361] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:44 2022] DELETE /identity/v3/users/079d6c51d7b844ffaa68ff6576c5c08c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:45.314167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:45.314782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:45.315051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:45.375518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:45.377034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:45.558562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1184/2362] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:45.570747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:45.572198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:45.815134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228afc7-20bd-442d-9719-63c58f5d1cb9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:45.833059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:45.836323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:45.839593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:45.840019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:45.861518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:45.864942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:45.914617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1179/2363] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:57:47.377326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:47.379801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:47.400791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63d487-0245-4423-b68a-c3d1673c4826 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:47.430301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:47.431218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:47.431502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:47.431781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] PATH_INFO: `/v3/projects/85216d07fb7d4220951fb8f583985514` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:47.441279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85216d07fb7d4220951fb8f583985514)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:47.443262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:47.558455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85216d07fb7d4220951fb8f583985514', 'request_id': 'req-faf17cbe-ba0e-4efe-862f-898781eac776'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:47.568767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:47.579398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85216d07fb7d4220951fb8f583985514', 'request_id': 'req-faf17cbe-ba0e-4efe-862f-898781eac776'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:47.591892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85216d07fb7d4220951fb8f583985514', 'request_id': 'req-faf17cbe-ba0e-4efe-862f-898781eac776'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:47.626683 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] The token cache is being invalidate because project 85216d07fb7d4220951fb8f583985514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:47.627023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:47.633367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:47.648689 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1185/2364] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:47 2022] DELETE /identity/v3/projects/85216d07fb7d4220951fb8f583985514 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:47.648931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:47.690968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e63a4-2acd-460a-b53e-fa187a16abdb service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:48.028160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:48.070364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:48.071070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:48.071436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:48.079571 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] PATH_INFO: `/v3/users/7ab1a78beb4e42999cc8a2ae3bf2ab9d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:48.088941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab1a78beb4e42999cc8a2ae3bf2ab9d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:48.091307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:48.224976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab1a78beb4e42999cc8a2ae3bf2ab9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:48.226539 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab1a78beb4e42999cc8a2ae3bf2ab9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:48.239756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab1a78beb4e42999cc8a2ae3bf2ab9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:48.243402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab1a78beb4e42999cc8a2ae3bf2ab9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:48.295047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92e73cbe-e515-4acb-9bf4-7f88d0518b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab1a78beb4e42999cc8a2ae3bf2ab9d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:48.415376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1180/2365] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:57:47 2022] DELETE /identity/v3/users/7ab1a78beb4e42999cc8a2ae3bf2ab9d => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:49.725635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:49.727086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:49.779861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf17cbe-ba0e-4efe-862f-898781eac776 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:49.938243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:49.939218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:49.939659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:49.975071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:49.976035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:49.976526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:49.976961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] PATH_INFO: `/v3/projects/4a4d01af21e74142b78a4403ecba9eb3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:49.980519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4d01af21e74142b78a4403ecba9eb3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:49.982262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:50.035580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] MFA Rules not processed for user `7c9b0cd44552494495aac989af4ac72e`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:50.037145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:50.091403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4d01af21e74142b78a4403ecba9eb3', 'request_id': 'req-67d4da38-2e37-4a95-a689-508013f18507'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:50.105561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4d01af21e74142b78a4403ecba9eb3', 'request_id': 'req-67d4da38-2e37-4a95-a689-508013f18507'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:50.122086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4d01af21e74142b78a4403ecba9eb3', 'request_id': 'req-67d4da38-2e37-4a95-a689-508013f18507'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:50.144143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] The token cache is being invalidate because project 4a4d01af21e74142b78a4403ecba9eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:57:50.144770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:50.145600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-67d4da38-2e37-4a95-a689-508013f18507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:57:50.147292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1186/2366] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:57:49 2022] DELETE /identity/v3/projects/4a4d01af21e74142b78a4403ecba9eb3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:50.152445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918281-3fe2-44cd-99da-4d19ba5044ff None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.153026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918281-3fe2-44cd-99da-4d19ba5044ff None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.153639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41918281-3fe2-44cd-99da-4d19ba5044ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.176221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-41918281-3fe2-44cd-99da-4d19ba5044ff None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:50.177972 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-41918281-3fe2-44cd-99da-4d19ba5044ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:50.308639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1187/2367] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:50.316132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ddb01-eda5-4075-8345-fb2d556af1bc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.316809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ddb01-eda5-4075-8345-fb2d556af1bc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.317260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ddb01-eda5-4075-8345-fb2d556af1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.319915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1181/2368] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:57:50.325075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:50.329600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:50.360472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7df934-1e12-47b2-b185-015f692d4a0c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:50.361635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-895ddb01-eda5-4075-8345-fb2d556af1bc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:50.363640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-895ddb01-eda5-4075-8345-fb2d556af1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:50.370838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:50.372855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.373510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.374340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.375772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:50.379897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:50.383476 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1188/2369] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:57:50.388651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ddb01-eda5-4075-8345-fb2d556af1bc None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:50.427054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ddb01-eda5-4075-8345-fb2d556af1bc None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:50.444971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1182/2370] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:50 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:50.450327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:50.454366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:50.455004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.455285 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.455557 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.456221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:57:50.459951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:50.461667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:50.468200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:50.507216 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1189/2371] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:57:50.511901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:50.527994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:50.533172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef602aa-1194-4914-8723-14fdfdb4590a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:50.604438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e05c4-9506-46b4-9262-53d7c463e6d4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:50.620258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:50.620855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.621133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.621410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.622054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:50.623998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:50.664861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1183/2372] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:50 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:50.668541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:50.671376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:50.672654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.673401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.674361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.675592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:50.679639 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:50.693827 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22429973-a0e1-4ad3-8d95-0c50674527e6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:50.726292 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:50.726927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.727253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.727496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.728120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:50.730305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:50.739882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1190/2373] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:57:50 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:50.745241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:50.752891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1184/2374] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:57:50.765451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:50.775846 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01a7fc-5c30-4a28-8f7f-3cd7fe0423e3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:50.905200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:50.905892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:50.906171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:50.906445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] PATH_INFO: `/v3/projects/3b64ac45b71d4cb88687883723a0aade/users/9da9290551a84d38ad1939adfb0e8eaf/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:50.934384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b64ac45b71d4cb88687883723a0aade, user_id=9da9290551a84d38ad1939adfb0e8eaf, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:50.937110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:50.967082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b57e5c-5cd9-405d-8413-67f64a184f21 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:50.978214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1185/2375] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:50 2022] PUT /identity/v3/projects/3b64ac45b71d4cb88687883723a0aade/users/9da9290551a84d38ad1939adfb0e8eaf/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:50.980829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:51.200453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cfd36-c4a2-4d78-b10b-e2ab812475c9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:51.223618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:51.224213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:51.224529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:51.224818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:51.225468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:51.227379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:51.250799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:51.251743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:51.257939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:51.258512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:51.259389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:51.262838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:51.267670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1186/2376] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:57:51.274668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:51.304243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c08a5-0d77-4395-a2c5-6a74dcd6499a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:51.312775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:51.313458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:51.313736 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:51.314009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] PATH_INFO: `/v3/projects/3b64ac45b71d4cb88687883723a0aade/users/9da9290551a84d38ad1939adfb0e8eaf/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:51.317314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b64ac45b71d4cb88687883723a0aade, user_id=9da9290551a84d38ad1939adfb0e8eaf, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:51.320005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:51.342777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1191/2377] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:57:50 2022] POST /identity/v3/users => generated 286 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:57:51.344298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:51.353133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1187/2378] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:51 2022] PUT /identity/v3/projects/3b64ac45b71d4cb88687883723a0aade/users/9da9290551a84d38ad1939adfb0e8eaf/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:51.363120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54d336-b98e-433b-b10c-63be02d79e0c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:51.418473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:51.528605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:51.529242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:51.529524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:51.529795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:51.530458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:51.532062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:51.568519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1192/2379] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:57:51.572911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:51.618876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4ab7-5e24-45a9-a5f3-30348a6016c7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:51.626588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a4970-0774-4b55-a617-fe475d6082e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:51.627212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a4970-0774-4b55-a617-fe475d6082e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:51.627486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a4970-0774-4b55-a617-fe475d6082e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:51.627761 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a4970-0774-4b55-a617-fe475d6082e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:51.628427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a4970-0774-4b55-a617-fe475d6082e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:51.630432 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a4970-0774-4b55-a617-fe475d6082e1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:51.655109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1188/2380] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:57:51.662134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:51.674179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb3e72-03d3-4b1f-b6db-c9a56b4523dd admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:51.702581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:51.718017 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:51.718744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:51.719466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] PATH_INFO: `/v3/projects/103c973803f34db2947a8a15de2e70a9/users/e4df514b4b5341abbdf04658dd663443/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:51.789488 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103c973803f34db2947a8a15de2e70a9, user_id=e4df514b4b5341abbdf04658dd663443, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:51.796160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:51.898763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1193/2381] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:57:51 2022] PUT /identity/v3/projects/103c973803f34db2947a8a15de2e70a9/users/e4df514b4b5341abbdf04658dd663443/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:57:51.900614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc66e-9306-438d-8d3f-a869828269f8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:51.908802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc66e-9306-438d-8d3f-a869828269f8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:51.909266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebc66e-9306-438d-8d3f-a869828269f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:51.949284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:57:51.963571 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-68ebc66e-9306-438d-8d3f-a869828269f8 None None] MFA Rules not processed for user `e4df514b4b5341abbdf04658dd663443`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:57:51.965023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-68ebc66e-9306-438d-8d3f-a869828269f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:52.138027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1189/2382] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:57:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:57:56.949833 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:57:56.954823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:57:57.047634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e797d-20e2-46df-b4d2-a4b5b1768e02 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:57:57.057790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a1ec98c3264279822a7b46fc20ac94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:57:57.058981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:57:57.059272 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:57:57.059551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:57:57.077226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:57:57.078706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:57:57.093006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1194/2383] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:57:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:01.508435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190023d3-9202-4eb4-bfb0-d8d3f0b86203 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:01.509378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190023d3-9202-4eb4-bfb0-d8d3f0b86203 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:01.509856 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190023d3-9202-4eb4-bfb0-d8d3f0b86203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:01.531769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-190023d3-9202-4eb4-bfb0-d8d3f0b86203 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:01.533386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-190023d3-9202-4eb4-bfb0-d8d3f0b86203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:01.651981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1190/2384] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 24 08:58:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:01.673730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:01.675545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:01.854533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498b322-bb31-4ffe-bc66-75095b070008 service glance] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:01.860691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:01.861530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:01.861980 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:01.862419 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:01.873961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:01.875842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:01.894127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1195/2385] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:58:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:58:02.553243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada46c0-0117-482a-8758-d2417adc92ff None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:02.554126 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada46c0-0117-482a-8758-d2417adc92ff None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:02.554408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada46c0-0117-482a-8758-d2417adc92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:02.601478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0ada46c0-0117-482a-8758-d2417adc92ff None None] MFA Rules not processed for user `9da9290551a84d38ad1939adfb0e8eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:02.602774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0ada46c0-0117-482a-8758-d2417adc92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:02.735158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1191/2386] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:58:02.759582 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:02.761551 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:02.783230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e2d2-d975-4425-be0f-9f2239475ca2 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:02.790018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a1ec98c3264279822a7b46fc20ac94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:02.791982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:02.809674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:02.810320 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:02.858048 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:02.931263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:02.934389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:02.952025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1196/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:03.158301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:03.158946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:03.159374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:03.193741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:03.195060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:03.208608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1192/2388] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:58:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:03.221908 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:03.236719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd2afc-cbbe-4ff4-90d4-ebe372d6cb82 service glance] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:03.252306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:03.253004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:03.253292 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:03.253568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:03.262679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:03.264895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:03.275300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1197/2389] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:58:04.458188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:04.460769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:04.541846 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:04.651141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d264a1c-607c-4d31-8973-faf31705e9da None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:04.659266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:04.660230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:04.660833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:04.661360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] PATH_INFO: `/v3/users/5ed2a2188b904bde9406ad42b640037b` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:04.663003 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed2a2188b904bde9406ad42b640037b)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:04.665532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:04.750667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed2a2188b904bde9406ad42b640037b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:04.752139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed2a2188b904bde9406ad42b640037b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:04.763076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed2a2188b904bde9406ad42b640037b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:04.763955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed2a2188b904bde9406ad42b640037b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:04.790983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3c7481c2-4a24-40cd-8134-7dbe128c5f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed2a2188b904bde9406ad42b640037b'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:04.836430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1193/2390] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:58:04 2022] DELETE /identity/v3/users/5ed2a2188b904bde9406ad42b640037b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:05.106982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:05.119960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27501a85-9b54-40b6-abd6-6b1631b17a5d None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.120296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27501a85-9b54-40b6-abd6-6b1631b17a5d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.120656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27501a85-9b54-40b6-abd6-6b1631b17a5d None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.121939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1194/2391] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:58:05.128140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368a57-9e92-4967-9d65-18997de21154 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.128597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368a57-9e92-4967-9d65-18997de21154 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.128890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b368a57-9e92-4967-9d65-18997de21154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.135587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a3b49-3b26-47a0-a083-5f7e98f32032 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:05.175805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7b368a57-9e92-4967-9d65-18997de21154 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:05.177065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7b368a57-9e92-4967-9d65-18997de21154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:05.294349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:05.295590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.296000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.296849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] PATH_INFO: `/v3/projects/c413788031e4458e90b72337b46fdf3f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.300631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c413788031e4458e90b72337b46fdf3f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:05.305261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:05.357811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1195/2392] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:58:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:05.416951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c413788031e4458e90b72337b46fdf3f', 'request_id': 'req-1dd21470-77de-4941-85b5-976c8bf2b55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:05.423781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c413788031e4458e90b72337b46fdf3f', 'request_id': 'req-1dd21470-77de-4941-85b5-976c8bf2b55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:05.435844 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c413788031e4458e90b72337b46fdf3f', 'request_id': 'req-1dd21470-77de-4941-85b5-976c8bf2b55f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:05.450126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] The token cache is being invalidate because project c413788031e4458e90b72337b46fdf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:58:05.450422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:05.451086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1dd21470-77de-4941-85b5-976c8bf2b55f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:05.452845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1198/2393] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:58:05 2022] DELETE /identity/v3/projects/c413788031e4458e90b72337b46fdf3f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:05.460868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b354d1-42ff-42fa-9cc3-953e6c9c5a20 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.461421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b354d1-42ff-42fa-9cc3-953e6c9c5a20 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.461801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b354d1-42ff-42fa-9cc3-953e6c9c5a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.487023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f8b354d1-42ff-42fa-9cc3-953e6c9c5a20 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:05.489959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f8b354d1-42ff-42fa-9cc3-953e6c9c5a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:05.535698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:05.596517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1196/2394] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:05.603878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab17da-dab6-42e5-adc8-71061bbd7efd None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.604264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab17da-dab6-42e5-adc8-71061bbd7efd None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.604572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab17da-dab6-42e5-adc8-71061bbd7efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.657594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-49ab17da-dab6-42e5-adc8-71061bbd7efd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:05.659141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-49ab17da-dab6-42e5-adc8-71061bbd7efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:05.672440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1199/2395] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:05.677008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b354d1-42ff-42fa-9cc3-953e6c9c5a20 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:05.691444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b354d1-42ff-42fa-9cc3-953e6c9c5a20 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:05.698785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:05.699647 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.700093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.716267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.717665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:58:05.717851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:05.720701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:05.743155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1197/2396] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:58:05.747812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab17da-dab6-42e5-adc8-71061bbd7efd None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:05.759277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab17da-dab6-42e5-adc8-71061bbd7efd None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:05.765963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:05.766955 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.767398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.768511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.769293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:05.771372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:05.841721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1200/2397] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:58:05 2022] POST /identity/v3/projects => generated 369 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:58:05.843392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:05.860060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268644e-d0d8-4e83-8798-c9868b439db1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:05.981753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:05.982414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:05.982696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:05.983030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:05.983672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:05.986077 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:06.016953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1198/2398] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:58:05 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:58:06.021564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:06.033602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3572ef-ff58-4e84-bf9c-37ed49aeca38 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:06.041687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:06.042724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:06.043007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:06.043283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:06.043944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:06.045587 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:06.047266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:06.071758 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1201/2399] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:58:06.072909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:06.089723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e51023-f235-4128-a9c4-ffe3b3b4538f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:06.104372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b676da0-2a2a-434c-a761-c317d8195bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:06.105163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b676da0-2a2a-434c-a761-c317d8195bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:06.105444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b676da0-2a2a-434c-a761-c317d8195bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:06.105720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b676da0-2a2a-434c-a761-c317d8195bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:06.106410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b676da0-2a2a-434c-a761-c317d8195bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:06.108780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b676da0-2a2a-434c-a761-c317d8195bc2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:06.125118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1199/2400] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:58:06.129267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:06.141973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87639356-1aa1-45fd-ae38-533a825ab145 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:06.149685 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:06.151086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:06.151519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:06.151974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] PATH_INFO: `/v3/projects/99bc24e3d5224c2d8e8d58fda78dcbd9/users/f044920f138847058e475bc2fd9e7bd3/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:06.174154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bc24e3d5224c2d8e8d58fda78dcbd9, user_id=f044920f138847058e475bc2fd9e7bd3, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:06.176869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:06.196922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1202/2401] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:58:06 2022] PUT /identity/v3/projects/99bc24e3d5224c2d8e8d58fda78dcbd9/users/f044920f138847058e475bc2fd9e7bd3/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:06.207603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5441e18-4fbb-43cd-b78a-84bd11a16d2a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:06.208061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5441e18-4fbb-43cd-b78a-84bd11a16d2a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:06.208447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5441e18-4fbb-43cd-b78a-84bd11a16d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:06.243624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a5441e18-4fbb-43cd-b78a-84bd11a16d2a None None] MFA Rules not processed for user `f044920f138847058e475bc2fd9e7bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:06.245065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a5441e18-4fbb-43cd-b78a-84bd11a16d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:06.332187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1200/2402] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:09.595857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:09.597647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:09.692652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6b7cc-1f42-4128-b8a2-6dadae29ab32 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:09.696544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12759e-b4f1-49b6-82da-ce5b737421d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a1ec98c3264279822a7b46fc20ac94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:09.697364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12759e-b4f1-49b6-82da-ce5b737421d4 service glance] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:09.697648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12759e-b4f1-49b6-82da-ce5b737421d4 service glance] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:09.697927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12759e-b4f1-49b6-82da-ce5b737421d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:09.700073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4f12759e-b4f1-49b6-82da-ce5b737421d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:09.794504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12759e-b4f1-49b6-82da-ce5b737421d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:09.794504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12759e-b4f1-49b6-82da-ce5b737421d4 service glance] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:09.806611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1203/2403] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:09.836675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5441e18-4fbb-43cd-b78a-84bd11a16d2a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:09.848282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5441e18-4fbb-43cd-b78a-84bd11a16d2a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:09.854650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f481-d481-4e08-b546-7dd4aaa8af10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8a1ec98c3264279822a7b46fc20ac94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:09.855517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f481-d481-4e08-b546-7dd4aaa8af10 service glance] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:09.856238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f481-d481-4e08-b546-7dd4aaa8af10 service glance] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:09.859951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f481-d481-4e08-b546-7dd4aaa8af10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:09.881369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9f481-d481-4e08-b546-7dd4aaa8af10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:09.882814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9f481-d481-4e08-b546-7dd4aaa8af10 service glance] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:09.896545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1201/2404] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:09.982480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7bef-99a1-4a7c-8e67-84f142d0d85c None None] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:09.982775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7bef-99a1-4a7c-8e67-84f142d0d85c None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:09.983060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d7bef-99a1-4a7c-8e67-84f142d0d85c None None] PATH_INFO: `/` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:09.985161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1204/2405] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:58:09.990459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3a8c4-8a0b-48ef-bfe8-109229767d72 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:09.990751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3a8c4-8a0b-48ef-bfe8-109229767d72 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:09.991034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3a8c4-8a0b-48ef-bfe8-109229767d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:10.014054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-38b3a8c4-8a0b-48ef-bfe8-109229767d72 None None] MFA Rules not processed for user `7194e3fe0d2d46ada270bb440cd79911`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:10.015281 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-38b3a8c4-8a0b-48ef-bfe8-109229767d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:10.034970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:10.079383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1202/2406] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:58:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:10.099263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7bef-99a1-4a7c-8e67-84f142d0d85c None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:10.101167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e74d7bef-99a1-4a7c-8e67-84f142d0d85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:10.119966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d7bef-99a1-4a7c-8e67-84f142d0d85c None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:10.125068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0453cf-e5ae-4432-b69e-f57875f56e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:10.126348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0453cf-e5ae-4432-b69e-f57875f56e16 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:10.126348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0453cf-e5ae-4432-b69e-f57875f56e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:10.126348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0453cf-e5ae-4432-b69e-f57875f56e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:10.141697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0453cf-e5ae-4432-b69e-f57875f56e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:10.143288 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0453cf-e5ae-4432-b69e-f57875f56e16 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:10.155890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1205/2407] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:10.300123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f31c9-ba47-452a-9610-7ee3f08fed11 None None] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:10.300511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f31c9-ba47-452a-9610-7ee3f08fed11 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:10.300887 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f31c9-ba47-452a-9610-7ee3f08fed11 None None] PATH_INFO: `/` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:10.302378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1203/2408] 10.222.0.42 () {54 vars in 921 bytes} [Wed Aug 24 08:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:58:10.311773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee608ef-466c-4186-b5b1-ad8d2ae46885 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:10.311773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee608ef-466c-4186-b5b1-ad8d2ae46885 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:10.311773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee608ef-466c-4186-b5b1-ad8d2ae46885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:10.339468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7ee608ef-466c-4186-b5b1-ad8d2ae46885 None None] MFA Rules not processed for user `a517cf1b373445fd9e98c4e703732153`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:10.340365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7ee608ef-466c-4186-b5b1-ad8d2ae46885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:10.370933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f31c9-ba47-452a-9610-7ee3f08fed11 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:10.373388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d44f31c9-ba47-452a-9610-7ee3f08fed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:10.378210 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1206/2409] 10.222.0.42 () {58 vars in 1018 bytes} [Wed Aug 24 08:58:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:10.394787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f31c9-ba47-452a-9610-7ee3f08fed11 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:10.400820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448b945-72bf-47fa-9178-7a8a10f8e421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:10.401958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b945-72bf-47fa-9178-7a8a10f8e421 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:10.402341 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b945-72bf-47fa-9178-7a8a10f8e421 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:10.402718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448b945-72bf-47fa-9178-7a8a10f8e421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:10.420438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448b945-72bf-47fa-9178-7a8a10f8e421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:10.422973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448b945-72bf-47fa-9178-7a8a10f8e421 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:10.442492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1204/2410] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:13.604732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:13.605286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:13.605407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:13.627232 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] MFA Rules not processed for user `7c9b0cd44552494495aac989af4ac72e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:13.628494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:13.678134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:13.688881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1207/2411] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:13.783807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:13.784332 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:13.784465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:13.821135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:13.822989 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:13.880877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1205/2412] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:58:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:13.895174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:13.895511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:13.966489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0eb01-e5e4-402e-b10d-92b216226d24 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:13.974088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfb28d-c7ca-4c79-bd72-3f44bd22f1e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:13.974722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfb28d-c7ca-4c79-bd72-3f44bd22f1e6 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:13.975008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfb28d-c7ca-4c79-bd72-3f44bd22f1e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:13.975284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfb28d-c7ca-4c79-bd72-3f44bd22f1e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:13.984875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfb28d-c7ca-4c79-bd72-3f44bd22f1e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:13.986493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfb28d-c7ca-4c79-bd72-3f44bd22f1e6 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:13.995052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1208/2413] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:58:22.333833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:22.335424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:22.427450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e2893-eca5-46d0-aa89-cf005df7feb4 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:22.432657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:22.433304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:22.433581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:22.433855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] PATH_INFO: `/v3/users/e4df514b4b5341abbdf04658dd663443` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:22.435032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4df514b4b5341abbdf04658dd663443)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:22.437039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:22.486853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4df514b4b5341abbdf04658dd663443'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:22.487519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4df514b4b5341abbdf04658dd663443'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:22.497701 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4df514b4b5341abbdf04658dd663443'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:22.498497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4df514b4b5341abbdf04658dd663443'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:22.502627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:22.507589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4df514b4b5341abbdf04658dd663443'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:22.533454 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1206/2414] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:58:22 2022] DELETE /identity/v3/users/e4df514b4b5341abbdf04658dd663443 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:22.538103 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:22.538745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:22.540546 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:22.561630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:22.563064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:22.638678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1209/2415] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:22.650617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:22.653546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:22.763228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82891d-e31c-43bb-b8bb-86b7daa9f28f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:22.767103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb97b7c-9c84-4815-846b-ed9847a0d090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:22.767878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb97b7c-9c84-4815-846b-ed9847a0d090 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:22.768166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb97b7c-9c84-4815-846b-ed9847a0d090 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:22.768497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb97b7c-9c84-4815-846b-ed9847a0d090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:22.779873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb97b7c-9c84-4815-846b-ed9847a0d090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:22.781858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb97b7c-9c84-4815-846b-ed9847a0d090 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:22.796715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1207/2416] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:23.128585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:23.130445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:23.151492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c83b779-2f17-441e-b76e-2437473f468e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:23.157800 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:23.158495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:23.158880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:23.159258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] PATH_INFO: `/v3/projects/103c973803f34db2947a8a15de2e70a9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:23.161068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103c973803f34db2947a8a15de2e70a9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:23.163305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:23.216904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103c973803f34db2947a8a15de2e70a9', 'request_id': 'req-53b67a61-47d2-483d-8a68-20c6d50f0835'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:23.223088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103c973803f34db2947a8a15de2e70a9', 'request_id': 'req-53b67a61-47d2-483d-8a68-20c6d50f0835'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:23.230432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103c973803f34db2947a8a15de2e70a9', 'request_id': 'req-53b67a61-47d2-483d-8a68-20c6d50f0835'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:23.242099 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] The token cache is being invalidate because project 103c973803f34db2947a8a15de2e70a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:58:23.242386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:23.243110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:23.244630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1210/2417] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:58:23 2022] DELETE /identity/v3/projects/103c973803f34db2947a8a15de2e70a9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:26.744073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:26.744640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:26.744742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:26.765044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:26.766112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:26.828775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1208/2418] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 08:58:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:26.853907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:26.855916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:26.874321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:26.954926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b67a61-47d2-483d-8a68-20c6d50f0835 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:26.962229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:26.962985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:26.963189 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:26.964256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:26.978695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:26.980845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:26.991254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1211/2419] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:58:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:58:36.821271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=59,keystone:DELETE=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:36.987834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=27 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:37.284561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:37.287000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:37.368702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed7cfc-2d22-422c-8b88-9d4f7111117d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:37.374081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e603b68-7201-4f35-a304-cc8a2431c976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:37.374743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603b68-7201-4f35-a304-cc8a2431c976 service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:37.375013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603b68-7201-4f35-a304-cc8a2431c976 service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:37.375285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e603b68-7201-4f35-a304-cc8a2431c976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:37.377105 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1e603b68-7201-4f35-a304-cc8a2431c976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:37.389160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e603b68-7201-4f35-a304-cc8a2431c976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:37.390743 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e603b68-7201-4f35-a304-cc8a2431c976 service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:37.401376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1209/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:38.044194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:38.045898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:38.111941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e34fe-82bb-4809-aa7c-775cd9823c93 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:38.116730 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:38.118105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:38.118386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:38.118659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] PATH_INFO: `/v3/users/f044920f138847058e475bc2fd9e7bd3` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:38.119843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f044920f138847058e475bc2fd9e7bd3)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:38.121825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:38.175250 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f044920f138847058e475bc2fd9e7bd3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.176023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f044920f138847058e475bc2fd9e7bd3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.176722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f044920f138847058e475bc2fd9e7bd3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.184579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f044920f138847058e475bc2fd9e7bd3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.193864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f044920f138847058e475bc2fd9e7bd3'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.216616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1212/2421] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:58:38 2022] DELETE /identity/v3/users/f044920f138847058e475bc2fd9e7bd3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:38.218457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:38.218923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:38.219468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:38.243673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:38.245241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:38.318717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1210/2422] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:38.329511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:38.331008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:38.392370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30fd01-3672-46e7-9f08-267e73ed3e4a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:38.396032 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3f493-2077-4067-abd3-28071d65a1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:38.396812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f493-2077-4067-abd3-28071d65a1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:38.397166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f493-2077-4067-abd3-28071d65a1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:38.397444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f493-2077-4067-abd3-28071d65a1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:38.406989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3f493-2077-4067-abd3-28071d65a1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:38.408538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3f493-2077-4067-abd3-28071d65a1e8 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:38.418635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1213/2423] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:38.761279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:38.762831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:38.776087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4e838-6def-445f-abe0-1ec552b5a248 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:38.781214 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:38.782085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:38.782571 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:38.783033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] PATH_INFO: `/v3/projects/99bc24e3d5224c2d8e8d58fda78dcbd9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:38.785396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bc24e3d5224c2d8e8d58fda78dcbd9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:38.787748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:38.841004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bc24e3d5224c2d8e8d58fda78dcbd9', 'request_id': 'req-be3714b5-78ba-4a57-b2be-a483f574ca86'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.847069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:38.847368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:38.847647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:38.848285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bc24e3d5224c2d8e8d58fda78dcbd9', 'request_id': 'req-be3714b5-78ba-4a57-b2be-a483f574ca86'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.855839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bc24e3d5224c2d8e8d58fda78dcbd9', 'request_id': 'req-be3714b5-78ba-4a57-b2be-a483f574ca86'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.868799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:38.869512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] The token cache is being invalidate because project 99bc24e3d5224c2d8e8d58fda78dcbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:58:38.869859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.870409 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:38.870538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-be3714b5-78ba-4a57-b2be-a483f574ca86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:38.872433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1211/2424] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:58:38 2022] DELETE /identity/v3/projects/99bc24e3d5224c2d8e8d58fda78dcbd9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:38.876857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068eb0-a9e5-422b-82d3-01937dc66a55 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:38.877082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068eb0-a9e5-422b-82d3-01937dc66a55 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:38.877364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0068eb0-a9e5-422b-82d3-01937dc66a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:38.897360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:38.906559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d0068eb0-a9e5-422b-82d3-01937dc66a55 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:38.907914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d0068eb0-a9e5-422b-82d3-01937dc66a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:38.917832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:38.942021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1214/2425] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 24 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:58:38.955296 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:38.956836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:38.970638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1212/2426] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:58:38.978867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b329e3-6313-41fb-83f5-2e83799827ef None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:38.979168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b329e3-6313-41fb-83f5-2e83799827ef None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:38.979450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b329e3-6313-41fb-83f5-2e83799827ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:38.999658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-66b329e3-6313-41fb-83f5-2e83799827ef None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:39.000904 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-66b329e3-6313-41fb-83f5-2e83799827ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:39.009688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1213/2427] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:39.014148 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b329e3-6313-41fb-83f5-2e83799827ef None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:39.022914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b329e3-6313-41fb-83f5-2e83799827ef None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.027768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b80b-8390-4596-88c0-a9ee07995f08 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.028150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.028821 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.029053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.029326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.029967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:58:39.030272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.031879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.032950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.033604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.033887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.034166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.043152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.047367 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1214/2428] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 08:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:58:39.047512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.048360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:39.053743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1215/2429] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 08:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:58:39.058591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593998e7-2b3d-4039-a800-90afaece764d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.063383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.064051 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.064337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.064639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.065263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.067257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.098424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1215/2430] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 08:58:39 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:58:39.103136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:39.114287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871db2db-8fcd-4e6e-a674-84330cd87924 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.182249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.182875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.183163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.183442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.184093 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.186318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.208195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1216/2431] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 08:58:39 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:58:39.213127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:39.223754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14443b69-4fbd-45cd-b770-9cf4f2ae7539 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.229561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.230286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.230650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.231025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.232080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.234180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.246187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1216/2432] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:58:39.251257 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:39.261892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5bfc2-7311-45cf-b21a-5cc5d627cba3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.266703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c6569-2143-4fde-9e74-f2609ca23b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.267298 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c6569-2143-4fde-9e74-f2609ca23b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.267588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c6569-2143-4fde-9e74-f2609ca23b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.267868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c6569-2143-4fde-9e74-f2609ca23b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.268698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c6569-2143-4fde-9e74-f2609ca23b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.270424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c6569-2143-4fde-9e74-f2609ca23b20 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.282896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1217/2433] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 08:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:58:39.287282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:39.299348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c4352-1379-4cca-9ff5-5c26471d01f3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.304600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.305305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.305603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.305876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] PATH_INFO: `/v3/projects/d91353f392364612856c8f4fc3363898/users/d6606ef2c310498c86d15cd190525f54/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.322440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91353f392364612856c8f4fc3363898, user_id=d6606ef2c310498c86d15cd190525f54, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.325189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.345023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1217/2434] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 08:58:39 2022] PUT /identity/v3/projects/d91353f392364612856c8f4fc3363898/users/d6606ef2c310498c86d15cd190525f54/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:39.357583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720140-4f37-4fa4-a41c-e281fe8a263e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.358472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720140-4f37-4fa4-a41c-e281fe8a263e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.358860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51720140-4f37-4fa4-a41c-e281fe8a263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.389443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-51720140-4f37-4fa4-a41c-e281fe8a263e None None] MFA Rules not processed for user `d6606ef2c310498c86d15cd190525f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:39.390609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-51720140-4f37-4fa4-a41c-e281fe8a263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:39.419024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:39.490660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1218/2435] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:58:39.501784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:39.503433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:39.560627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00996e5d-1f2b-4106-a4fd-4e0c33927e42 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:39.566198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4becf168-84fc-4492-a09e-2aaf8781b13e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:39.566970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf168-84fc-4492-a09e-2aaf8781b13e service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:39.567258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf168-84fc-4492-a09e-2aaf8781b13e service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:39.567536 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4becf168-84fc-4492-a09e-2aaf8781b13e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:39.580110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becf168-84fc-4492-a09e-2aaf8781b13e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:39.581913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4becf168-84fc-4492-a09e-2aaf8781b13e service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:39.594255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1218/2436] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:49.487895 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=16 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:49.588436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=80,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:50.081023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51720140-4f37-4fa4-a41c-e281fe8a263e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:50.156259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51720140-4f37-4fa4-a41c-e281fe8a263e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:50.161445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:50.162177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:50.162536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:50.163511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] PATH_INFO: `/v3/users/d6606ef2c310498c86d15cd190525f54` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:50.164746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6606ef2c310498c86d15cd190525f54)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:50.166702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:50.215107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6606ef2c310498c86d15cd190525f54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.215774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6606ef2c310498c86d15cd190525f54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.216417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6606ef2c310498c86d15cd190525f54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.223299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6606ef2c310498c86d15cd190525f54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.231658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6606ef2c310498c86d15cd190525f54'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.249355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1219/2437] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 08:58:50 2022] DELETE /identity/v3/users/d6606ef2c310498c86d15cd190525f54 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:50.253794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:50.254081 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:50.254353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:50.274272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:50.275451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:50.333031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1219/2438] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:58:50.342869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:50.344332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:50.402688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ea4cb-a55f-4ac6-b959-131815d5cb72 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:50.406336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:50.406934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:50.407212 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:50.407482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:50.416166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:50.417613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:50.432480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1220/2439] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:50.730038 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:50.731636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:50.773845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd25c-1f9b-490c-b4d4-b3a0ca64c388 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:50.781231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:50.782007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:50.782348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:50.782689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] PATH_INFO: `/v3/projects/d91353f392364612856c8f4fc3363898` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:50.784545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91353f392364612856c8f4fc3363898)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:50.787183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:50.852945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91353f392364612856c8f4fc3363898', 'request_id': 'req-d5f4c8ce-940a-4679-9464-073ae816022a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.861791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91353f392364612856c8f4fc3363898', 'request_id': 'req-d5f4c8ce-940a-4679-9464-073ae816022a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.869389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91353f392364612856c8f4fc3363898', 'request_id': 'req-d5f4c8ce-940a-4679-9464-073ae816022a'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.886042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] The token cache is being invalidate because project d91353f392364612856c8f4fc3363898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:58:50.886042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.886791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-d5f4c8ce-940a-4679-9464-073ae816022a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:58:50.892453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1220/2440] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 08:58:50 2022] DELETE /identity/v3/projects/d91353f392364612856c8f4fc3363898 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:58:54.244146 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:58:54.245609 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:54.257647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e764ef-572c-44c7-bc99-56d766fb9e81 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:58:54.276339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:58:54.317897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4143-328e-4b7b-9a06-da61b5c4f210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:58:54.318610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4143-328e-4b7b-9a06-da61b5c4f210 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:54.318998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4143-328e-4b7b-9a06-da61b5c4f210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:54.319344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4143-328e-4b7b-9a06-da61b5c4f210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:54.321154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c6ba4143-328e-4b7b-9a06-da61b5c4f210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:54.395427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba4143-328e-4b7b-9a06-da61b5c4f210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:58:54.396920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba4143-328e-4b7b-9a06-da61b5c4f210 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:58:54.407694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1221/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 08:58:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:58:58.925422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9171e-6b0d-4eda-91bc-bd6eb8c8a3bf None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:58:58.925925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9171e-6b0d-4eda-91bc-bd6eb8c8a3bf None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:58:58.926008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9171e-6b0d-4eda-91bc-bd6eb8c8a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:58:58.945718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-90c9171e-6b0d-4eda-91bc-bd6eb8c8a3bf None None] MFA Rules not processed for user `1d6c68a0197548ab91bd66342974dd28`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:58:58.946944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-90c9171e-6b0d-4eda-91bc-bd6eb8c8a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:58:59.007019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1221/2442] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:58:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:59:04.402896 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=40 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:08.999452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:09.113937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b2ae-1e26-449b-843c-22aa7df18e11 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:59:09.114422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b2ae-1e26-449b-843c-22aa7df18e11 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:59:09.114529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b2ae-1e26-449b-843c-22aa7df18e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:59:09.133615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-80a6b2ae-1e26-449b-843c-22aa7df18e11 None None] MFA Rules not processed for user `f0602554c12e4710912338a9ddccbbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:59:09.134746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-80a6b2ae-1e26-449b-843c-22aa7df18e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:59:09.200493 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1222/2443] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:59:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:59:19.192666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=25 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:59:28.277878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:59:28.278430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:59:28.278430 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:59:28.298586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] MFA Rules not processed for user `a42d659ce7bb4946bd082a07d9339e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:59:28.299799 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:59:28.354073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1222/2444] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 08:59:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:59:38.347387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=25 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:15.673440 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc451b38-fde8-4f27-9ad2-57a6818c1d82 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:15.674517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc451b38-fde8-4f27-9ad2-57a6818c1d82 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:15.674793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc451b38-fde8-4f27-9ad2-57a6818c1d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:15.696243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-cc451b38-fde8-4f27-9ad2-57a6818c1d82 None None] MFA Rules not processed for user `1d6c68a0197548ab91bd66342974dd28`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:15.697574 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cc451b38-fde8-4f27-9ad2-57a6818c1d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:15.704661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1223/2445] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:18.343208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:18.344919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:18.416670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb8bf-4596-4f2e-a5b0-4131e898ab60 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:18.421218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:18.421840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:18.422123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:18.422402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] PATH_INFO: `/v3/users/f0602554c12e4710912338a9ddccbbd2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:18.423537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0602554c12e4710912338a9ddccbbd2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:18.425550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:18.474600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0602554c12e4710912338a9ddccbbd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.475262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0602554c12e4710912338a9ddccbbd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.482777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0602554c12e4710912338a9ddccbbd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.483435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0602554c12e4710912338a9ddccbbd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.491426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9455023b-6c03-4648-a092-ef2975d388b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0602554c12e4710912338a9ddccbbd2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.510262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1223/2446] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:00:18 2022] DELETE /identity/v3/users/f0602554c12e4710912338a9ddccbbd2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:18.690457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc451b38-fde8-4f27-9ad2-57a6818c1d82 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:18.710768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc451b38-fde8-4f27-9ad2-57a6818c1d82 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:18.783333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:18.784206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:18.785088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:18.785364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] PATH_INFO: `/v3/projects/2826b194b41142218006535f9eeec332` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:18.786705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2826b194b41142218006535f9eeec332)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:18.788681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:18.852469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2826b194b41142218006535f9eeec332', 'request_id': 'req-de2bf5f1-1738-4862-911b-fcb3f34637cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.865907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2826b194b41142218006535f9eeec332', 'request_id': 'req-de2bf5f1-1738-4862-911b-fcb3f34637cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.876773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2826b194b41142218006535f9eeec332', 'request_id': 'req-de2bf5f1-1738-4862-911b-fcb3f34637cc'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.892236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] The token cache is being invalidate because project 2826b194b41142218006535f9eeec332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:00:18.892643 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.893579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-de2bf5f1-1738-4862-911b-fcb3f34637cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:18.896459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1224/2447] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:00:18 2022] DELETE /identity/v3/projects/2826b194b41142218006535f9eeec332 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:18.900780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976694a-d246-4159-8eee-f22e698e822b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:18.901073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976694a-d246-4159-8eee-f22e698e822b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:18.901388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976694a-d246-4159-8eee-f22e698e822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:18.924687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d976694a-d246-4159-8eee-f22e698e822b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:18.925966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d976694a-d246-4159-8eee-f22e698e822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:18.994439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1224/2448] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:19.002312 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad397377-e187-4af1-bf4f-9b70a784ed02 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.002675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad397377-e187-4af1-bf4f-9b70a784ed02 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.003055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad397377-e187-4af1-bf4f-9b70a784ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.024135 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ad397377-e187-4af1-bf4f-9b70a784ed02 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:19.025554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ad397377-e187-4af1-bf4f-9b70a784ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:19.034928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1225/2449] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:00:19.039071 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976694a-d246-4159-8eee-f22e698e822b None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.049638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976694a-d246-4159-8eee-f22e698e822b None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.055053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.055671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.055948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.056221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.056915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:00:19.057217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.058832 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.072831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1225/2450] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:00:19.077869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad397377-e187-4af1-bf4f-9b70a784ed02 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.087586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad397377-e187-4af1-bf4f-9b70a784ed02 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.093603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.094271 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.094553 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.094825 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.095461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.097965 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.129815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1226/2451] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:00:19 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:00:19.140108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.150643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32bb7-7140-4978-809b-da5c8b4acbcf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.156741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:19.218090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.218707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.218986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.219260 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.219882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.222343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.246964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1226/2452] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:00:19 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:00:19.248466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.259047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91473b-5fcb-44d9-94b8-61a3297b1631 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.264261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.264906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.265188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.265464 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.266112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.267702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.279345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1227/2453] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:19.283831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.295531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a0e95-2ffb-4665-bc53-dcb8aefa3e9e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.300731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3347b16-d2a9-4f72-a7ac-8ea222c1ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.301346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3347b16-d2a9-4f72-a7ac-8ea222c1ee4d admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.301629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3347b16-d2a9-4f72-a7ac-8ea222c1ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.301906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3347b16-d2a9-4f72-a7ac-8ea222c1ee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.302556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3347b16-d2a9-4f72-a7ac-8ea222c1ee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.304162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3347b16-d2a9-4f72-a7ac-8ea222c1ee4d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.315170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1227/2454] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:00:19.319850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.330754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b5ed9-5c43-447e-ae4e-2e493fdf2216 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.336132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.336869 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.337153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.337436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] PATH_INFO: `/v3/projects/fc087ee185894fe68daf998815b7bf02/users/3a8c2486f53a49f0973c0a619ec1ed88/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.352729 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc087ee185894fe68daf998815b7bf02, user_id=3a8c2486f53a49f0973c0a619ec1ed88, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.355737 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.375842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1228/2455] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:00:19 2022] PUT /identity/v3/projects/fc087ee185894fe68daf998815b7bf02/users/3a8c2486f53a49f0973c0a619ec1ed88/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:19.386775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15f65-4802-4b90-9ea2-c80ceb5f0c5a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.387286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15f65-4802-4b90-9ea2-c80ceb5f0c5a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.387498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15f65-4802-4b90-9ea2-c80ceb5f0c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.416096 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-eea15f65-4802-4b90-9ea2-c80ceb5f0c5a None None] MFA Rules not processed for user `3a8c2486f53a49f0973c0a619ec1ed88`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:19.417685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eea15f65-4802-4b90-9ea2-c80ceb5f0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:19.491322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1228/2456] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:19.492695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.533244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:19.585907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb408c-1b76-4e2d-aefb-da763e692e4f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.590623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.591233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.591516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.591794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.592483 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.594380 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.625572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1229/2457] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:00:19 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:00:19.627083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea15f65-4802-4b90-9ea2-c80ceb5f0c5a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.638463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea15f65-4802-4b90-9ea2-c80ceb5f0c5a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.695259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.695871 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.696153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.696457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.697093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.699001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.725438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1229/2458] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:00:19 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:00:19.726341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.737199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795276f7-e29b-4c8f-a484-3ff986e9a80a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.742434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.743043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.743327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.743766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.744441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.746226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.757915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1230/2459] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:19.762245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.769121 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:19.773048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a13ae0-b884-4f3c-82d5-2b0414b61afe admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.779019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.779692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.779976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.780252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] PATH_INFO: `/v3/projects/0523438826964a6f91a77a1e2f851188/users/60f4f50df93e4c29b5ec333544405f0c/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.795556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] RBAC: Authorizing `identity:create_grant(project_id=0523438826964a6f91a77a1e2f851188, user_id=60f4f50df93e4c29b5ec333544405f0c, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.798252 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.812758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1230/2460] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:00:19 2022] PUT /identity/v3/projects/0523438826964a6f91a77a1e2f851188/users/60f4f50df93e4c29b5ec333544405f0c/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:19.816718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.826705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6d30a-047f-4333-85da-40a510610989 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.886252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b559d1-7fa0-4356-b9ed-c340c35bc6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.887454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b559d1-7fa0-4356-b9ed-c340c35bc6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.888182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b559d1-7fa0-4356-b9ed-c340c35bc6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.888182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b559d1-7fa0-4356-b9ed-c340c35bc6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.888670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b559d1-7fa0-4356-b9ed-c340c35bc6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.890388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b559d1-7fa0-4356-b9ed-c340c35bc6cf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.900489 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1231/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:19.904515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:19.915435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d930e2-6acc-41e0-846c-ed00dfddfece admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:19.920200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:19.921023 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.921313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.921588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] PATH_INFO: `/v3/projects/0523438826964a6f91a77a1e2f851188/users/60f4f50df93e4c29b5ec333544405f0c/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.923558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0523438826964a6f91a77a1e2f851188, user_id=60f4f50df93e4c29b5ec333544405f0c, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:19.926405 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:19.936901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1231/2462] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:00:19 2022] PUT /identity/v3/projects/0523438826964a6f91a77a1e2f851188/users/60f4f50df93e4c29b5ec333544405f0c/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:00:19.948958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf2c0e-20b9-4204-8d93-c6d7c5f898aa None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:19.949248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf2c0e-20b9-4204-8d93-c6d7c5f898aa None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:19.949529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf2c0e-20b9-4204-8d93-c6d7c5f898aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:19.980774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9bdf2c0e-20b9-4204-8d93-c6d7c5f898aa None None] MFA Rules not processed for user `60f4f50df93e4c29b5ec333544405f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:19.982029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9bdf2c0e-20b9-4204-8d93-c6d7c5f898aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:20.051734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1232/2463] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:19 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:20.063306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:20.065029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:20.121716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a518d2-5587-43ab-af35-2e0eae300a66 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:20.125298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfc65c-1a98-4e22-a128-deda22b08b1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:20.125893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc65c-1a98-4e22-a128-deda22b08b1c service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:20.126173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc65c-1a98-4e22-a128-deda22b08b1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:20.126446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfc65c-1a98-4e22-a128-deda22b08b1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:20.135224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc65c-1a98-4e22-a128-deda22b08b1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:20.136752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfc65c-1a98-4e22-a128-deda22b08b1c service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:20.146792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1232/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:20 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:20.301126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf2c0e-20b9-4204-8d93-c6d7c5f898aa None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:20.318313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:20.364799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf2c0e-20b9-4204-8d93-c6d7c5f898aa None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:20.369241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:20.369867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:20.370153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:20.370433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] PATH_INFO: `/v3/users/3a8c2486f53a49f0973c0a619ec1ed88` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:20.371555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a8c2486f53a49f0973c0a619ec1ed88)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:20.373501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:20.419109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a8c2486f53a49f0973c0a619ec1ed88'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:20.419768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a8c2486f53a49f0973c0a619ec1ed88'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:20.420454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a8c2486f53a49f0973c0a619ec1ed88'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:20.427981 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a8c2486f53a49f0973c0a619ec1ed88'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:20.435056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a8c2486f53a49f0973c0a619ec1ed88'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:20.452248 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1233/2465] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:00:20 2022] DELETE /identity/v3/users/3a8c2486f53a49f0973c0a619ec1ed88 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:20.456883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:20.457383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:20.457492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:20.475689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:20.476922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:20.534396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1233/2466] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:20.543941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:20.545333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:20.610937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48362e61-a3f0-431a-9f75-642045e60986 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:20.615209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:20.615820 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:20.616101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:20.616374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:20.625078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:20.626494 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:20.635667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1234/2467] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:20.933037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:20.934481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:20.946222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95798e4-5f02-4686-abed-40efae8285c1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:20.950987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:20.952070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:20.952070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:20.952283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] PATH_INFO: `/v3/projects/fc087ee185894fe68daf998815b7bf02` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:20.953453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc087ee185894fe68daf998815b7bf02)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:20.955371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:21.005850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc087ee185894fe68daf998815b7bf02', 'request_id': 'req-0b9d0929-515e-46dd-8098-cc4eb55079c8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.011910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc087ee185894fe68daf998815b7bf02', 'request_id': 'req-0b9d0929-515e-46dd-8098-cc4eb55079c8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.018367 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc087ee185894fe68daf998815b7bf02', 'request_id': 'req-0b9d0929-515e-46dd-8098-cc4eb55079c8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.021966 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:21.037098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] The token cache is being invalidate because project fc087ee185894fe68daf998815b7bf02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:00:21.037407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.038193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.039638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1234/2468] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:00:20 2022] DELETE /identity/v3/projects/fc087ee185894fe68daf998815b7bf02 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:21.043580 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:21.053862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9cce1-ae64-4e2f-9d0a-61a4d8ec1f4f service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:21.089731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:21.117845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:21.118540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.118834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.119137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] PATH_INFO: `/v3/users/60f4f50df93e4c29b5ec333544405f0c` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.120279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f4f50df93e4c29b5ec333544405f0c)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:21.122368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:21.172049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f4f50df93e4c29b5ec333544405f0c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.172731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f4f50df93e4c29b5ec333544405f0c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.173398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f4f50df93e4c29b5ec333544405f0c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.181015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f4f50df93e4c29b5ec333544405f0c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.191150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0a8db817-4a1f-40af-8674-66613c76e2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f4f50df93e4c29b5ec333544405f0c'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.219565 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1235/2469] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:00:21 2022] DELETE /identity/v3/users/60f4f50df93e4c29b5ec333544405f0c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:21.509778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:21.511323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:21.526173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d0929-515e-46dd-8098-cc4eb55079c8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:21.583406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:21.584055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.584334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.584638 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] PATH_INFO: `/v3/projects/0523438826964a6f91a77a1e2f851188` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.585798 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0523438826964a6f91a77a1e2f851188)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:21.587730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:21.635841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0523438826964a6f91a77a1e2f851188', 'request_id': 'req-b33e9bd7-6668-4477-9bf4-accff8474640'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.641428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0523438826964a6f91a77a1e2f851188', 'request_id': 'req-b33e9bd7-6668-4477-9bf4-accff8474640'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.648238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0523438826964a6f91a77a1e2f851188', 'request_id': 'req-b33e9bd7-6668-4477-9bf4-accff8474640'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.659785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] The token cache is being invalidate because project 0523438826964a6f91a77a1e2f851188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:00:21.660078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.660749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-b33e9bd7-6668-4477-9bf4-accff8474640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:21.662309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1235/2470] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:00:21 2022] DELETE /identity/v3/projects/0523438826964a6f91a77a1e2f851188 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:21.668106 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646457f-ebdf-4958-8693-cd4e3203d917 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.668418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646457f-ebdf-4958-8693-cd4e3203d917 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.668708 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646457f-ebdf-4958-8693-cd4e3203d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.688265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9646457f-ebdf-4958-8693-cd4e3203d917 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:21.689434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9646457f-ebdf-4958-8693-cd4e3203d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:21.748618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1236/2471] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:21.756982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee7ec-8b0f-42b8-9444-82af07920286 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.757274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee7ec-8b0f-42b8-9444-82af07920286 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.757559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ee7ec-8b0f-42b8-9444-82af07920286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.778491 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-082ee7ec-8b0f-42b8-9444-82af07920286 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:21.779712 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-082ee7ec-8b0f-42b8-9444-82af07920286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:21.787802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1236/2472] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:21.792027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646457f-ebdf-4958-8693-cd4e3203d917 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:21.802225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646457f-ebdf-4958-8693-cd4e3203d917 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:21.806747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:21.807350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.807630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.807903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.808679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:00:21.808986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:21.810573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:21.821931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1237/2473] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:00:21.826165 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee7ec-8b0f-42b8-9444-82af07920286 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:21.835920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ee7ec-8b0f-42b8-9444-82af07920286 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:21.840598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:21.841193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.841469 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.841740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.842353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:21.844321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:21.871967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1237/2474] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:00:21 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:00:21.876045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:21.886349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d817e6-b986-4e12-8c38-e9c5b0ecb3e0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:21.925988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:21.942175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:21.942726 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.943010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.943287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.943919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:21.945949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:21.966327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1238/2475] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:00:21 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:00:21.970321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:21.980892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a59d-32fd-4883-8063-c947e068b5c5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:21.985481 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:21.986074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:21.986358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:21.986634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:21.987794 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:21.989502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:21.999273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1238/2476] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:22.003039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.012752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531a494-1cd1-4df3-aa58-0b5d3e84be6f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.017480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14f18f-a35d-4774-bd09-559710a80dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.018076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f18f-a35d-4774-bd09-559710a80dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.018356 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f18f-a35d-4774-bd09-559710a80dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.019134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14f18f-a35d-4774-bd09-559710a80dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.019778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14f18f-a35d-4774-bd09-559710a80dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.021429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14f18f-a35d-4774-bd09-559710a80dd0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.031745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1239/2477] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:22.035674 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.045732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ac2fc-6b10-457d-b36a-c8e4d80eec69 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.050775 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.051415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.051696 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.051973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] PATH_INFO: `/v3/projects/06d570c549a2434ab8693d7ea3b6dd61/users/f2822df20e8c460eb9addedcc05182cf/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.067029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d570c549a2434ab8693d7ea3b6dd61, user_id=f2822df20e8c460eb9addedcc05182cf, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.069951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.083073 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1239/2478] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:00:22 2022] PUT /identity/v3/projects/06d570c549a2434ab8693d7ea3b6dd61/users/f2822df20e8c460eb9addedcc05182cf/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:22.093339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303519-42e9-4a10-9c14-a09e0296b695 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.093819 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303519-42e9-4a10-9c14-a09e0296b695 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.093928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a303519-42e9-4a10-9c14-a09e0296b695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.122143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2a303519-42e9-4a10-9c14-a09e0296b695 None None] MFA Rules not processed for user `f2822df20e8c460eb9addedcc05182cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:22.123359 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2a303519-42e9-4a10-9c14-a09e0296b695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:22.186521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1240/2479] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:22.191016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.211166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:22.252520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6eda40-169c-43d9-b48b-6dea437b70a9 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.257776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.258376 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.258654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.258926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.259542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.261494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.287708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1240/2480] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:00:22 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:00:22.291847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303519-42e9-4a10-9c14-a09e0296b695 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.302561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a303519-42e9-4a10-9c14-a09e0296b695 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.357832 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.358467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.358750 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.359026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.359648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.361667 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.383236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1241/2481] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:00:22 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:00:22.392185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.402769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332857b-5d5e-4621-a5b5-593ce40a46ba admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.407360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.407962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.408245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.408558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.409746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.411771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.423465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1241/2482] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:22.428243 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.438300 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12a3ab-f915-46b9-afb1-887758acf32f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.442920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.443571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.443854 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.444130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] PATH_INFO: `/v3/projects/06268ad8ab5440bb8aee9c523319f3f7/users/d425348716734f2d823de0b1a51bed14/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.459186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06268ad8ab5440bb8aee9c523319f3f7, user_id=d425348716734f2d823de0b1a51bed14, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.461974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.475009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1242/2483] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:00:22 2022] PUT /identity/v3/projects/06268ad8ab5440bb8aee9c523319f3f7/users/d425348716734f2d823de0b1a51bed14/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:22.478901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.489310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a218878-e6de-4817-a67c-efbd4c00ce53 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.547409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb56e4-0358-4d94-a323-08469e5c6e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.548029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb56e4-0358-4d94-a323-08469e5c6e1e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.548289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb56e4-0358-4d94-a323-08469e5c6e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.548596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb56e4-0358-4d94-a323-08469e5c6e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.549249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb56e4-0358-4d94-a323-08469e5c6e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.551057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb56e4-0358-4d94-a323-08469e5c6e1e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.561220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1242/2484] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:22.565622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.577107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de93065-390e-4bb8-98e7-66bfe4fc0b4b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.583047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.583839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.584131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.584439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] PATH_INFO: `/v3/projects/06268ad8ab5440bb8aee9c523319f3f7/users/d425348716734f2d823de0b1a51bed14/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.586422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06268ad8ab5440bb8aee9c523319f3f7, user_id=d425348716734f2d823de0b1a51bed14, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.589126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.601006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1243/2485] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:00:22 2022] PUT /identity/v3/projects/06268ad8ab5440bb8aee9c523319f3f7/users/d425348716734f2d823de0b1a51bed14/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:22.612593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.612880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.613157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.640390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] MFA Rules not processed for user `d425348716734f2d823de0b1a51bed14`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:22.641627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:22.710135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1243/2486] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:22.721543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.723866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:22.730610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:22.782082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4150e-8d21-4e5f-8db8-9f870f817707 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.785733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.786329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.786610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.786887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.795586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.797058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.806830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1244/2487] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:22 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:22.853435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:22.855119 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:22.867732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26180cb5-f18c-45c4-83e8-516bc7117f23 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:22.871323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:22.871921 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:22.872203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:22.872518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:22.884209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:22.929302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:22.930781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:22.939639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1244/2488] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:24.909688 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:24.911208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:24.981319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118972-2ab8-42e9-822f-1e60022fbbce service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:24.985406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:24.986919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:24.987698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:24.987979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:24.992262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:25.061585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:25.062999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:25.074569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1245/2489] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:26.261691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:26.274860 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:26.277494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33f68-4a09-42d6-9bdd-0bdc0cf3a89b service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:26.281151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b000bfb-62c1-4ec7-b604-a6880ccba0ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:26.281788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b000bfb-62c1-4ec7-b604-a6880ccba0ff service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:26.282069 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b000bfb-62c1-4ec7-b604-a6880ccba0ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:26.282344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b000bfb-62c1-4ec7-b604-a6880ccba0ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:26.284237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2b000bfb-62c1-4ec7-b604-a6880ccba0ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:26.299276 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b000bfb-62c1-4ec7-b604-a6880ccba0ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:26.301300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b000bfb-62c1-4ec7-b604-a6880ccba0ff service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:26.312418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1245/2490] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:26.333503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:26.348371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e02d-125e-4875-b10c-3da7a40b5ffd service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:26.353251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:26.354547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:26.354934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:26.355459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] PATH_INFO: `/v3/users/f2822df20e8c460eb9addedcc05182cf` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:26.358308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2822df20e8c460eb9addedcc05182cf)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:26.359967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:26.417157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2822df20e8c460eb9addedcc05182cf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:26.417884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2822df20e8c460eb9addedcc05182cf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:26.418501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2822df20e8c460eb9addedcc05182cf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:26.427435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2822df20e8c460eb9addedcc05182cf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:26.436941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2822df20e8c460eb9addedcc05182cf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:26.459371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1246/2491] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:00:26 2022] DELETE /identity/v3/users/f2822df20e8c460eb9addedcc05182cf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:00:26.463785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:26.464078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:26.464667 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:26.485833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:26.487198 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:26.549699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1246/2492] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:26.560570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:26.562454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:26.629858 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969c31f-2afb-496f-9a9d-ef9cfbed5e7b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:26.633677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:26.634291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:26.634594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:26.634892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:26.644666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:26.646076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:26.655486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1247/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:26.924691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:26.926123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:26.938229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4af91-4cd1-4bf4-b2f3-f41a3498eb36 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:26.943533 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:26.944169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:26.944487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:26.944768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] PATH_INFO: `/v3/projects/06d570c549a2434ab8693d7ea3b6dd61` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:26.945891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d570c549a2434ab8693d7ea3b6dd61)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:26.947980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:26.996808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d570c549a2434ab8693d7ea3b6dd61', 'request_id': 'req-1bba52ba-a36e-46a5-94a9-c96f57dbf800'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.002423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d570c549a2434ab8693d7ea3b6dd61', 'request_id': 'req-1bba52ba-a36e-46a5-94a9-c96f57dbf800'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.009155 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d570c549a2434ab8693d7ea3b6dd61', 'request_id': 'req-1bba52ba-a36e-46a5-94a9-c96f57dbf800'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.021755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] The token cache is being invalidate because project 06d570c549a2434ab8693d7ea3b6dd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:00:27.022045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.022660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.024142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1247/2494] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:00:26 2022] DELETE /identity/v3/projects/06d570c549a2434ab8693d7ea3b6dd61 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:27.028149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:27.038573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e90967-3fe9-4b0a-80ef-cce062535f66 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:27.094058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:27.094735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:27.095090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:27.095372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] PATH_INFO: `/v3/users/d425348716734f2d823de0b1a51bed14` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:27.096743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d425348716734f2d823de0b1a51bed14)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:27.098766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:27.111014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:27.152217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd425348716734f2d823de0b1a51bed14'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.152816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd425348716734f2d823de0b1a51bed14'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.153545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd425348716734f2d823de0b1a51bed14'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.165569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd425348716734f2d823de0b1a51bed14'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.177109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-911b1a1d-042a-4a65-9042-d587df97369f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd425348716734f2d823de0b1a51bed14'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.195549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1248/2495] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:00:27 2022] DELETE /identity/v3/users/d425348716734f2d823de0b1a51bed14 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:27.499176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:27.500784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:27.522300 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba52ba-a36e-46a5-94a9-c96f57dbf800 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:27.559283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:27.621284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:27.621920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:27.622196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:27.622470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] PATH_INFO: `/v3/projects/06268ad8ab5440bb8aee9c523319f3f7` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:27.623586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06268ad8ab5440bb8aee9c523319f3f7)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:27.625554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:27.688927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06268ad8ab5440bb8aee9c523319f3f7', 'request_id': 'req-81253c9d-be18-467a-aaf1-a761ec64a3c8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.699986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06268ad8ab5440bb8aee9c523319f3f7', 'request_id': 'req-81253c9d-be18-467a-aaf1-a761ec64a3c8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.708149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06268ad8ab5440bb8aee9c523319f3f7', 'request_id': 'req-81253c9d-be18-467a-aaf1-a761ec64a3c8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.723021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] The token cache is being invalidate because project 06268ad8ab5440bb8aee9c523319f3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:00:27.723318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.724107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-81253c9d-be18-467a-aaf1-a761ec64a3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:27.725777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1248/2496] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:00:27 2022] DELETE /identity/v3/projects/06268ad8ab5440bb8aee9c523319f3f7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:27.732190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd634c7-a3bc-4b55-8904-3b2e11c0c63d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:27.732905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd634c7-a3bc-4b55-8904-3b2e11c0c63d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:27.733186 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd634c7-a3bc-4b55-8904-3b2e11c0c63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:27.761821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8cd634c7-a3bc-4b55-8904-3b2e11c0c63d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:27.763027 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8cd634c7-a3bc-4b55-8904-3b2e11c0c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:27.825136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1249/2497] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:00:27.833290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b259d2-5379-449d-8d39-f1c32346539e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:27.833754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b259d2-5379-449d-8d39-f1c32346539e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:27.834037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b259d2-5379-449d-8d39-f1c32346539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:27.853626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-32b259d2-5379-449d-8d39-f1c32346539e None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:27.855089 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-32b259d2-5379-449d-8d39-f1c32346539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:27.864122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1249/2498] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:27.868465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd634c7-a3bc-4b55-8904-3b2e11c0c63d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:27.878692 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd634c7-a3bc-4b55-8904-3b2e11c0c63d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:27.883555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:27.884162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:27.884903 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:27.885179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:27.885938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:00:27.886241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:27.887829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:27.900132 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1250/2499] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:00:27.904556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b259d2-5379-449d-8d39-f1c32346539e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:27.914193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b259d2-5379-449d-8d39-f1c32346539e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:27.918992 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:27.919602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:27.919894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:27.920722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:27.920879 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:27.922885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:27.951614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1250/2500] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:00:27 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:00:27.956319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:27.967142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bed3d9-b367-41e7-be63-bb08df96d6ee admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:28.026141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:28.026809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:28.027029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:28.027319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:28.027977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:28.030015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:28.052952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1251/2501] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:00:27 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:00:28.057391 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:28.069903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e904c-e984-462b-9655-494107136b4f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:28.077027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:28.077710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:28.078049 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:28.078399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:28.079152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:28.081513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:28.095729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1251/2502] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:28.099631 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:28.111362 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2757a-8de7-4d38-844d-5481f4804ec4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:28.116769 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af831-6257-4c58-9398-eb40314e35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:28.117591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af831-6257-4c58-9398-eb40314e35ed admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:28.117942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af831-6257-4c58-9398-eb40314e35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:28.119010 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af831-6257-4c58-9398-eb40314e35ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:28.120239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9af831-6257-4c58-9398-eb40314e35ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:28.122039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9af831-6257-4c58-9398-eb40314e35ed admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:28.124958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:28.143538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:28.151109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1252/2503] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:00:28.156909 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2f325-37e1-497b-a486-e57b674890ab admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:28.163321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:28.164053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:28.164439 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:28.164730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] PATH_INFO: `/v3/projects/e2c551c660cc4a479fc3cb5e545aee36/users/01b42bfd23334d4a8c477af08a178607/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:28.187478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c551c660cc4a479fc3cb5e545aee36, user_id=01b42bfd23334d4a8c477af08a178607, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:28.191344 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:28.205680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1252/2504] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:00:28 2022] PUT /identity/v3/projects/e2c551c660cc4a479fc3cb5e545aee36/users/01b42bfd23334d4a8c477af08a178607/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:28.210660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87f4be-7610-4a67-8e0a-a3864f0639f3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:28.211024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87f4be-7610-4a67-8e0a-a3864f0639f3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:28.211304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87f4be-7610-4a67-8e0a-a3864f0639f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:28.230550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3a87f4be-7610-4a67-8e0a-a3864f0639f3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:28.231760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3a87f4be-7610-4a67-8e0a-a3864f0639f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:28.291194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1253/2505] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:28.301407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:28.303099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:28.361749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36212bc2-35d7-4ee7-bf24-aef404553bbc admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:28.365529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:28.366147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:28.366431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:28.366708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:28.372683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:28.377289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:28.379346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:28.390188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1253/2506] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:29.029867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d6f70-8c17-45bb-a189-23b8e007b389 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:29.030418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d6f70-8c17-45bb-a189-23b8e007b389 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:29.030418 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d6f70-8c17-45bb-a189-23b8e007b389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:29.067251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8f8d6f70-8c17-45bb-a189-23b8e007b389 None None] MFA Rules not processed for user `01b42bfd23334d4a8c477af08a178607`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:29.068841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8f8d6f70-8c17-45bb-a189-23b8e007b389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:29.152647 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1254/2507] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:29.165590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:29.167141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:29.239336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9138ddb-65b6-4c93-8e6d-93c9fb5bb221 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:29.244132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a7a87-7eb4-452e-a0b1-cfb3f50416d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:29.244781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7a87-7eb4-452e-a0b1-cfb3f50416d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:29.245061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7a87-7eb4-452e-a0b1-cfb3f50416d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:29.245335 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a7a87-7eb4-452e-a0b1-cfb3f50416d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:29.255336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a7a87-7eb4-452e-a0b1-cfb3f50416d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:29.256975 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a7a87-7eb4-452e-a0b1-cfb3f50416d1 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:29.275532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1254/2508] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:30.731332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:30.731898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:30.731898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:30.751589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] MFA Rules not processed for user `01b42bfd23334d4a8c477af08a178607`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:30.752999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:30.762068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1255/2509] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:39.263505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=29 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:39.715062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b33248-303e-4131-8aa1-3f7d1e5a9c1b None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:39.715350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b33248-303e-4131-8aa1-3f7d1e5a9c1b None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:39.715634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b33248-303e-4131-8aa1-3f7d1e5a9c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:39.734708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-03b33248-303e-4131-8aa1-3f7d1e5a9c1b None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:39.735910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-03b33248-303e-4131-8aa1-3f7d1e5a9c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:39.790330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1255/2510] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 24 09:00:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:39.838916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:39.840330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:39.907191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17e9c-648d-455c-9b84-75574870def1 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:39.912118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:39.912757 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:39.913038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:39.913306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:39.921946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:39.924028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:39.932136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1256/2511] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:00:41.493453 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:41.493988 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:41.494093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:41.514939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:41.516262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:41.524144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1256/2512] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 09:00:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:41.537540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:41.548897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee40967-5e9d-4982-a777-9f03bfcffbec service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:41.554555 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:41.555222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:41.555554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:41.555836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:41.562547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:41.565406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:41.567635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:41.577134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1257/2513] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:00:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:00:46.305853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:46.308163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:46.440758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d58f19-fdcf-4598-b9bd-3c47955c6f9e None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:46.447459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:46.448665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:46.449166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:46.451104 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:46.453401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:46.537464 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:46.539158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:46.550787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1257/2514] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:49.186839 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:49.190121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:49.223872 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4027a6-9735-4eda-b677-5026913a4259 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:49.229420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:49.230314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:49.230734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:49.231124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] PATH_INFO: `/v3/users/7c9b0cd44552494495aac989af4ac72e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:49.233365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9b0cd44552494495aac989af4ac72e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:49.236174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:49.316053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9b0cd44552494495aac989af4ac72e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.316813 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9b0cd44552494495aac989af4ac72e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.317456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9b0cd44552494495aac989af4ac72e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.333192 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9b0cd44552494495aac989af4ac72e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.343427 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9b0cd44552494495aac989af4ac72e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.369671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1258/2515] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:00:49 2022] DELETE /identity/v3/users/7c9b0cd44552494495aac989af4ac72e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:49.611095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:49.630786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb438b41-15da-4c66-a94b-5f1ef4deb39d service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:49.669573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:49.700097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:49.700923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:49.701302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:49.701673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] PATH_INFO: `/v3/projects/29c82b31ed264ecda4c4357f1de1ff91` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:49.703267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c82b31ed264ecda4c4357f1de1ff91)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:49.706807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:49.772616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c82b31ed264ecda4c4357f1de1ff91', 'request_id': 'req-ea617b8b-37f6-40c4-8003-cdce0daffa8c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.783477 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c82b31ed264ecda4c4357f1de1ff91', 'request_id': 'req-ea617b8b-37f6-40c4-8003-cdce0daffa8c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.793379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c82b31ed264ecda4c4357f1de1ff91', 'request_id': 'req-ea617b8b-37f6-40c4-8003-cdce0daffa8c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.829189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] The token cache is being invalidate because project 29c82b31ed264ecda4c4357f1de1ff91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:00:49.829483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.830524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:49.837280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1258/2516] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:00:49 2022] DELETE /identity/v3/projects/29c82b31ed264ecda4c4357f1de1ff91 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:49.838097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:49.841502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:49.859116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e766df2-bd42-4fe2-b702-970d2cc2664d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:49.940059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:49.941042 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:49.941315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:49.941593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] PATH_INFO: `/v3/users/9da9290551a84d38ad1939adfb0e8eaf` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:49.942739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da9290551a84d38ad1939adfb0e8eaf)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:49.944733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:50.019888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da9290551a84d38ad1939adfb0e8eaf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.020687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da9290551a84d38ad1939adfb0e8eaf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.021325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da9290551a84d38ad1939adfb0e8eaf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.029241 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da9290551a84d38ad1939adfb0e8eaf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.038653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da9290551a84d38ad1939adfb0e8eaf'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.051293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:50.061294 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1259/2517] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:00:49 2022] DELETE /identity/v3/users/9da9290551a84d38ad1939adfb0e8eaf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:00:50.288786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:50.290861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:50.325382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea617b8b-37f6-40c4-8003-cdce0daffa8c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:50.395336 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:50.396001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:50.396494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:50.396779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] PATH_INFO: `/v3/projects/3b64ac45b71d4cb88687883723a0aade` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:50.398139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b64ac45b71d4cb88687883723a0aade)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:50.400174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:50.484163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b64ac45b71d4cb88687883723a0aade', 'request_id': 'req-3668bccb-7101-4a48-a732-a7b530ef57de'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.497305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b64ac45b71d4cb88687883723a0aade', 'request_id': 'req-3668bccb-7101-4a48-a732-a7b530ef57de'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.513001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b64ac45b71d4cb88687883723a0aade', 'request_id': 'req-3668bccb-7101-4a48-a732-a7b530ef57de'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.526908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:00:50.540056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] The token cache is being invalidate because project 3b64ac45b71d4cb88687883723a0aade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:00:50.540601 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.542831 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:00:50.550465 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1259/2518] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:00:50 2022] DELETE /identity/v3/projects/3b64ac45b71d4cb88687883723a0aade => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:00:53.154256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:53.155603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:53.216019 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83cdf4-ddb3-4ac2-ab18-8e1c905bc42e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:53.264259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef500a-eee1-497f-a3bf-1871705f6f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:53.264936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef500a-eee1-497f-a3bf-1871705f6f07 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:53.265220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef500a-eee1-497f-a3bf-1871705f6f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:53.265517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef500a-eee1-497f-a3bf-1871705f6f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:53.267897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b1ef500a-eee1-497f-a3bf-1871705f6f07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:53.278157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef500a-eee1-497f-a3bf-1871705f6f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:53.279595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef500a-eee1-497f-a3bf-1871705f6f07 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:53.288357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1260/2519] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:57.927205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:57.928650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:57.996908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668bccb-7101-4a48-a732-a7b530ef57de admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:58.001902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:58.002505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:58.002788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:58.003061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:58.004792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:58.015797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:58.017991 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:58.027608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1260/2520] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:00:59.765881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:59.767016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:59.767198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:59.786036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:00:59.787245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:59.848791 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1261/2521] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 09:00:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:00:59.861154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:00:59.862741 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:00:59.937301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389d577-d6f2-4d86-a8d0-0f3e72cadaa5 service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:00:59.942962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72241-6861-4dee-881c-9c59e75ed175 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:00:59.943577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72241-6861-4dee-881c-9c59e75ed175 service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:00:59.943925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72241-6861-4dee-881c-9c59e75ed175 service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:00:59.944204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72241-6861-4dee-881c-9c59e75ed175 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:00:59.953382 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc72241-6861-4dee-881c-9c59e75ed175 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:00:59.955883 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc72241-6861-4dee-881c-9c59e75ed175 service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:00:59.965012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1261/2522] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:00:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:01:09.114706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:09.116270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:09.175000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:09.200451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aaea5-0264-4004-a152-2d011a35160e None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:09.206460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:09.207072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:09.207355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:09.207632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:09.209449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:09.268117 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:09.269759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:09.278793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1262/2523] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:09.961496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=66 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:12.423746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266856-a842-4338-8948-e1021af6bd74 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:12.424378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266856-a842-4338-8948-e1021af6bd74 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:12.424504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b266856-a842-4338-8948-e1021af6bd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:12.446114 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9b266856-a842-4338-8948-e1021af6bd74 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:12.447262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9b266856-a842-4338-8948-e1021af6bd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:12.512138 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1262/2524] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:12.534548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:12.547444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83c2ac-ffde-4269-81dc-b4e4eda070da service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:12.553085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d2f37-7f4a-4a1c-aaf5-ca13e63ca2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:12.553697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2f37-7f4a-4a1c-aaf5-ca13e63ca2e4 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:12.553979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2f37-7f4a-4a1c-aaf5-ca13e63ca2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:12.554252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d2f37-7f4a-4a1c-aaf5-ca13e63ca2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:12.562632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d2f37-7f4a-4a1c-aaf5-ca13e63ca2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:12.564205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d2f37-7f4a-4a1c-aaf5-ca13e63ca2e4 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:12.577905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1263/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:14.006508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b266856-a842-4338-8948-e1021af6bd74 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:14.020819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b266856-a842-4338-8948-e1021af6bd74 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:14.044698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:14.046065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:14.048295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:14.048618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:14.051575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:14.074240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:14.078017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:14.090924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1263/2526] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:15.435223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef0285-1d06-4591-aa0d-94e641324a62 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:15.435764 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef0285-1d06-4591-aa0d-94e641324a62 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:15.435861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef0285-1d06-4591-aa0d-94e641324a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:15.456240 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-51ef0285-1d06-4591-aa0d-94e641324a62 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:15.457402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-51ef0285-1d06-4591-aa0d-94e641324a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:15.465142 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1264/2527] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:15.487402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:15.488848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:15.502917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0551177-92f6-4ffb-b1b9-015b1d9bcca1 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:15.508346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:15.508962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:15.509245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:15.509520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:15.518258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:15.519845 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:15.529157 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1264/2528] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:17.964564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffd027-b322-4d33-8055-9593186cf912 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:17.965054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffd027-b322-4d33-8055-9593186cf912 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:17.965178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffd027-b322-4d33-8055-9593186cf912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:17.985624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-1fffd027-b322-4d33-8055-9593186cf912 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:17.986867 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-1fffd027-b322-4d33-8055-9593186cf912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:17.994083 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1265/2529] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 24 09:01:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:18.006606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:18.019204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7cf16-ad7e-46a3-b08e-b6a5f6244908 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:18.025237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bb4d4-d94b-4ed1-adbb-b3f0bee13c8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:18.026054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb4d4-d94b-4ed1-adbb-b3f0bee13c8b service swift] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:18.026467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb4d4-d94b-4ed1-adbb-b3f0bee13c8b service swift] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:18.026870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bb4d4-d94b-4ed1-adbb-b3f0bee13c8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:18.037327 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bb4d4-d94b-4ed1-adbb-b3f0bee13c8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:18.038934 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bb4d4-d94b-4ed1-adbb-b3f0bee13c8b service swift] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:18.047672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1265/2530] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:01:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:01:19.645992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffd027-b322-4d33-8055-9593186cf912 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:19.660978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffd027-b322-4d33-8055-9593186cf912 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:19.666809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:19.667421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:19.667922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:19.668519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:19.670511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:19.687140 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:19.688989 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:19.712180 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1266/2531] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:01:19.742389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:19.742896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:19.743042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:19.780040 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:19.781361 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:19.818711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1266/2532] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:19.846696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:19.864727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3327b-30a6-4985-902b-cbd6040717a1 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:19.874725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafedbdf-af19-4fb0-8c89-17a9d5b43c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:19.875641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafedbdf-af19-4fb0-8c89-17a9d5b43c0a service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:19.876095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafedbdf-af19-4fb0-8c89-17a9d5b43c0a service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:19.876577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafedbdf-af19-4fb0-8c89-17a9d5b43c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:19.886891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafedbdf-af19-4fb0-8c89-17a9d5b43c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:19.888847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafedbdf-af19-4fb0-8c89-17a9d5b43c0a service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:19.899327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1267/2533] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:25.227795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:25.229273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:25.242180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0cfa6-c8f5-4d9c-8c36-63a1e8a84516 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:25.245770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:25.246370 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:25.246657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:25.246972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:25.248804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:25.260919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:25.262705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:25.272700 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1267/2534] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:27.988959 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:27.989891 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:27.990267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:28.009996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:28.011316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:28.020028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1268/2535] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:28.039545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:28.051933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4df8e-a365-4dee-8054-d85568b561c6 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:28.057403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:28.058037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:28.058314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:28.058584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:28.068670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:28.070434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:28.081186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1268/2536] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:28.458533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:28.460101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:28.477358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1da14-414a-4489-9b6a-e7f61547e2af None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:28.482378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:28.483605 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:28.483882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:28.484280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] PATH_INFO: `/v3/users/1d6c68a0197548ab91bd66342974dd28` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:28.485363 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6c68a0197548ab91bd66342974dd28)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:28.487287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:28.533187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6c68a0197548ab91bd66342974dd28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.533837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6c68a0197548ab91bd66342974dd28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.534458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6c68a0197548ab91bd66342974dd28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.541572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6c68a0197548ab91bd66342974dd28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.549396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ad96f915-5e1a-4617-bf9a-8a92cf0d3def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6c68a0197548ab91bd66342974dd28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.563484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:28.568239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1269/2537] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:01:28 2022] DELETE /identity/v3/users/1d6c68a0197548ab91bd66342974dd28 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:28.743264 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:28.753911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8604-2657-49b6-87eb-074b71d625a5 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:28.815234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:28.815861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:28.816139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:28.816508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] PATH_INFO: `/v3/projects/dbf5e3c7a7d04f9596a090175bf71321` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:28.817640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf5e3c7a7d04f9596a090175bf71321)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:28.819529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:28.853447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:28.868082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf5e3c7a7d04f9596a090175bf71321', 'request_id': 'req-6333a0c0-503b-4538-81fe-9a02beb9b034'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.873956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf5e3c7a7d04f9596a090175bf71321', 'request_id': 'req-6333a0c0-503b-4538-81fe-9a02beb9b034'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.880020 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf5e3c7a7d04f9596a090175bf71321', 'request_id': 'req-6333a0c0-503b-4538-81fe-9a02beb9b034'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.892459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] The token cache is being invalidate because project dbf5e3c7a7d04f9596a090175bf71321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:01:28.892754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.893392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6333a0c0-503b-4538-81fe-9a02beb9b034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:28.894877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1269/2538] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:01:28 2022] DELETE /identity/v3/projects/dbf5e3c7a7d04f9596a090175bf71321 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:28.899805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153c9e-f3bb-4027-b0f2-97835c4f8919 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:28.900163 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153c9e-f3bb-4027-b0f2-97835c4f8919 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:28.900584 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd153c9e-f3bb-4027-b0f2-97835c4f8919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:28.921062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-bd153c9e-f3bb-4027-b0f2-97835c4f8919 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:28.922273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bd153c9e-f3bb-4027-b0f2-97835c4f8919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:28.983456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1270/2539] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:28.991594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbb5a2-53a2-4fcf-9388-5ffc684a9f23 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:28.991910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbb5a2-53a2-4fcf-9388-5ffc684a9f23 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:28.992186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbbb5a2-53a2-4fcf-9388-5ffc684a9f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.013241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-6fbbb5a2-53a2-4fcf-9388-5ffc684a9f23 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:29.015129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-6fbbb5a2-53a2-4fcf-9388-5ffc684a9f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:29.023098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1270/2540] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:29.027259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd153c9e-f3bb-4027-b0f2-97835c4f8919 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:29.037442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd153c9e-f3bb-4027-b0f2-97835c4f8919 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:29.041982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:29.042583 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.042861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.043515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.043772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:01:29.044072 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:29.046307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:29.061993 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1271/2541] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:01:29.063681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbb5a2-53a2-4fcf-9388-5ffc684a9f23 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:29.073078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbbb5a2-53a2-4fcf-9388-5ffc684a9f23 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:29.077789 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:29.078395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.078670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.078943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.079568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:29.081522 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:29.112707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1271/2542] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:01:29 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:29.113883 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:29.124157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495acd0a-2a5c-44ed-8187-d8f6cbfee11d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:29.180009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:29.180644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.180934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.181206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.181818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:29.183721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:29.205261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1272/2543] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:01:29 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:29.209390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:29.220478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb458422-113b-460b-9294-ff81b229e699 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:29.225172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:29.225770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.226231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.226506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.227594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:29.229255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:29.239678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1272/2544] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:29.243522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:29.253618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca13f13-4b38-42a8-be15-9052f81802c9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:29.258345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33520b0-8658-421b-b6d0-616fcccee742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:29.258946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33520b0-8658-421b-b6d0-616fcccee742 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.259229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33520b0-8658-421b-b6d0-616fcccee742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.259506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33520b0-8658-421b-b6d0-616fcccee742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.260156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33520b0-8658-421b-b6d0-616fcccee742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:29.261781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33520b0-8658-421b-b6d0-616fcccee742 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:29.274367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1273/2545] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:29.278644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:29.289309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7318bf-ac45-491a-aae7-77c6b987a6e5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:29.293933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:29.294579 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.294863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.295137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] PATH_INFO: `/v3/projects/2ce7121b51134c6f921e0a065578fef6/users/0fb9268f55e3413a8dc91287bd057d5f/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.309554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce7121b51134c6f921e0a065578fef6, user_id=0fb9268f55e3413a8dc91287bd057d5f, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:29.312173 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:29.324286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1273/2546] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:01:29 2022] PUT /identity/v3/projects/2ce7121b51134c6f921e0a065578fef6/users/0fb9268f55e3413a8dc91287bd057d5f/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:29.334838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb977e-de1f-48f1-810a-e7ba46eaf890 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.335154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb977e-de1f-48f1-810a-e7ba46eaf890 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.335438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb977e-de1f-48f1-810a-e7ba46eaf890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.364566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-d2eb977e-de1f-48f1-810a-e7ba46eaf890 None None] MFA Rules not processed for user `0fb9268f55e3413a8dc91287bd057d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:29.365777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d2eb977e-de1f-48f1-810a-e7ba46eaf890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:29.421569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:29.432071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1274/2547] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:29.442660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:29.444330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:29.503995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f605d-1877-4591-914d-e7a42f351a42 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:29.507623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:29.508245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:29.508542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:29.508815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:29.516980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:29.518448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:29.526985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1274/2548] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:31.150909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01cae-4a1e-4bfd-bbe5-95ed3d702da0 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:31.151389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01cae-4a1e-4bfd-bbe5-95ed3d702da0 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:31.151475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e01cae-4a1e-4bfd-bbe5-95ed3d702da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:31.175738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a7e01cae-4a1e-4bfd-bbe5-95ed3d702da0 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:31.177101 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a7e01cae-4a1e-4bfd-bbe5-95ed3d702da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:31.241731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1275/2549] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:31.265026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:31.266422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:31.321486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:31.341061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9a5e1-e0ca-486d-9a98-518f3c50df8f service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:31.346519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:31.347061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:31.347339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:31.347610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:31.355662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:31.357290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:31.366421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1275/2550] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:34.314175 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6d921-33d2-424e-81a7-c71f5dba5c6d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:34.314652 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6d921-33d2-424e-81a7-c71f5dba5c6d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:34.314748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6d921-33d2-424e-81a7-c71f5dba5c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:34.335013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2ae6d921-33d2-424e-81a7-c71f5dba5c6d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:34.336217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2ae6d921-33d2-424e-81a7-c71f5dba5c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:34.344232 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1276/2551] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:34.364219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:34.375855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8048d-51f9-4097-901d-7cce149e9b50 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:34.381425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e217706-beff-478f-97f4-4d2e2d37a45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:34.382027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e217706-beff-478f-97f4-4d2e2d37a45c service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:34.382312 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e217706-beff-478f-97f4-4d2e2d37a45c service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:34.382588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e217706-beff-478f-97f4-4d2e2d37a45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:34.391525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e217706-beff-478f-97f4-4d2e2d37a45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:34.393149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e217706-beff-478f-97f4-4d2e2d37a45c service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:34.402868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1276/2552] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:37.924360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6d921-33d2-424e-81a7-c71f5dba5c6d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:37.934607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6d921-33d2-424e-81a7-c71f5dba5c6d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:37.939134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:37.939765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:37.940043 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:37.940314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] PATH_INFO: `/v3/users/0fb9268f55e3413a8dc91287bd057d5f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:37.941465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb9268f55e3413a8dc91287bd057d5f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:37.943370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:37.989848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb9268f55e3413a8dc91287bd057d5f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:37.990537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb9268f55e3413a8dc91287bd057d5f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:37.991187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb9268f55e3413a8dc91287bd057d5f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:37.999005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb9268f55e3413a8dc91287bd057d5f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:38.006807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb9268f55e3413a8dc91287bd057d5f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:38.027477 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1277/2553] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:01:37 2022] DELETE /identity/v3/users/0fb9268f55e3413a8dc91287bd057d5f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:38.032355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.032952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.033060 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.052172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:38.053400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:38.115401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1277/2554] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:38.125295 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:38.126840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:38.185629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471358-01a4-4501-a4fb-463e9905f461 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:38.189335 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb578886-cd71-48d0-84fd-c8d90c5b5833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:38.190337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb578886-cd71-48d0-84fd-c8d90c5b5833 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.190337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb578886-cd71-48d0-84fd-c8d90c5b5833 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.190509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb578886-cd71-48d0-84fd-c8d90c5b5833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.200544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb578886-cd71-48d0-84fd-c8d90c5b5833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:38.202810 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb578886-cd71-48d0-84fd-c8d90c5b5833 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:38.213654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1278/2555] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:38.485782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:38.487362 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:38.501894 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42583b-9967-4c95-a2a4-4bbc550f37c6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:38.506514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:38.507153 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.507443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.507715 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] PATH_INFO: `/v3/projects/2ce7121b51134c6f921e0a065578fef6` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.508872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce7121b51134c6f921e0a065578fef6)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:38.511599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:38.559443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce7121b51134c6f921e0a065578fef6', 'request_id': 'req-0b7d860b-f27d-42d9-b828-30220d404ec8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:38.565654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce7121b51134c6f921e0a065578fef6', 'request_id': 'req-0b7d860b-f27d-42d9-b828-30220d404ec8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:38.571793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce7121b51134c6f921e0a065578fef6', 'request_id': 'req-0b7d860b-f27d-42d9-b828-30220d404ec8'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:38.585006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] The token cache is being invalidate because project 2ce7121b51134c6f921e0a065578fef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:01:38.585302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:38.586093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b7d860b-f27d-42d9-b828-30220d404ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:38.587580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1278/2556] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:01:38 2022] DELETE /identity/v3/projects/2ce7121b51134c6f921e0a065578fef6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:01:38.592517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac28ce-59d3-41a1-bc6e-dc5227a50946 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.592929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac28ce-59d3-41a1-bc6e-dc5227a50946 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.593305 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac28ce-59d3-41a1-bc6e-dc5227a50946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.604018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:38.618172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8bac28ce-59d3-41a1-bc6e-dc5227a50946 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:38.619406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8bac28ce-59d3-41a1-bc6e-dc5227a50946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:38.679986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1279/2557] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:38.688877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aafb-e48e-4537-be4d-d04fee8637a8 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.689159 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aafb-e48e-4537-be4d-d04fee8637a8 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.689431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aafb-e48e-4537-be4d-d04fee8637a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.709240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e661aafb-e48e-4537-be4d-d04fee8637a8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:38.710427 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e661aafb-e48e-4537-be4d-d04fee8637a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:38.718263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1279/2558] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:38.722760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac28ce-59d3-41a1-bc6e-dc5227a50946 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:38.733005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac28ce-59d3-41a1-bc6e-dc5227a50946 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:38.737534 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:38.738166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.738449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.738731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.739384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:01:38.739691 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:38.741413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:38.757961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1280/2559] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:01:38.759348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aafb-e48e-4537-be4d-d04fee8637a8 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:38.770302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aafb-e48e-4537-be4d-d04fee8637a8 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:38.775110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:38.775925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.776207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.776586 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.778220 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:38.780164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:38.814204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1280/2560] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:01:38 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:01:38.816543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:38.827600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3364e-c83d-460a-81db-e2d91df1c884 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:38.887165 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:38.887874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.888157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.888501 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.889732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:38.891740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:38.914696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1281/2561] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:01:38 2022] POST /identity/v3/users => generated 279 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:38.918872 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:38.929646 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5067-a19d-4432-a273-c3495e3d2439 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:38.937226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:38.938064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.938420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.938705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.939369 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:38.941162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:38.953120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1281/2562] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:38.957107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:38.967162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eb2ab-9134-4a20-965c-3f92f3a867c5 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:38.971781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06028f-b084-41f3-b065-b3d32d441b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:38.972406 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06028f-b084-41f3-b065-b3d32d441b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:38.972699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06028f-b084-41f3-b065-b3d32d441b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:38.972978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06028f-b084-41f3-b065-b3d32d441b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:38.973628 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06028f-b084-41f3-b065-b3d32d441b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:38.975207 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06028f-b084-41f3-b065-b3d32d441b4a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:38.986881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1282/2563] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:01:38.990957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.001731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04f0d9-9660-430e-9710-0681b34fb194 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.006353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.006997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.007280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.007556 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] PATH_INFO: `/v3/projects/705dfb0e8e614d21a1391e2caa3b7a07/users/de706153edc34f9fa4234e0d1a63d06b/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.018949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:39.023600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=705dfb0e8e614d21a1391e2caa3b7a07, user_id=de706153edc34f9fa4234e0d1a63d06b, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.026554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.040823 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1282/2564] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:01:38 2022] PUT /identity/v3/projects/705dfb0e8e614d21a1391e2caa3b7a07/users/de706153edc34f9fa4234e0d1a63d06b/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:39.052351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50372dc5-aafb-44aa-9a7c-e4ef108b1936 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.052672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50372dc5-aafb-44aa-9a7c-e4ef108b1936 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.052985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50372dc5-aafb-44aa-9a7c-e4ef108b1936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.080852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-50372dc5-aafb-44aa-9a7c-e4ef108b1936 None None] MFA Rules not processed for user `de706153edc34f9fa4234e0d1a63d06b`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:39.082067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-50372dc5-aafb-44aa-9a7c-e4ef108b1936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:39.142593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:39.146766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1283/2565] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:39.151409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.216082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fb6f5-cfcd-4907-ba58-7bb28ad57d1a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.221468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.222074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.222359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.222634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.223267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.225193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.251048 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1283/2566] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:01:39 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:39.255109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50372dc5-aafb-44aa-9a7c-e4ef108b1936 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.266444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50372dc5-aafb-44aa-9a7c-e4ef108b1936 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.322544 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.323152 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.323433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.323706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.324333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.327958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.348233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1284/2567] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:01:39 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:39.352517 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.362851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca90381-230d-42ac-89e3-befa4042c7e5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.367398 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.367995 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.368279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.368588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.369230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.370835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.382780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1284/2568] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:01:39.387686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.402461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7ab0-5a50-43ee-9b7e-83d8f9f6f107 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.407345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.407983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.408253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.408636 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] PATH_INFO: `/v3/projects/628e516dad5d4be88df3b5a3203da2fe/users/4cdf4e219390400ea41387fc764dc5ed/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.424699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=628e516dad5d4be88df3b5a3203da2fe, user_id=4cdf4e219390400ea41387fc764dc5ed, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.427337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.441364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1285/2569] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:01:39 2022] PUT /identity/v3/projects/628e516dad5d4be88df3b5a3203da2fe/users/4cdf4e219390400ea41387fc764dc5ed/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:01:39.445470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.456058 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46589689-faea-4d93-8ca8-626ccd57550c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.511365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b63084-9e73-4397-b158-cb37c4713674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.511888 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b63084-9e73-4397-b158-cb37c4713674 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.512166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b63084-9e73-4397-b158-cb37c4713674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.512459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b63084-9e73-4397-b158-cb37c4713674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.513091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b63084-9e73-4397-b158-cb37c4713674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.515356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b63084-9e73-4397-b158-cb37c4713674 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.524819 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1285/2570] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:39.529056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.539191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03a79b-fd8f-4597-a48a-1b273582e958 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.543732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.544504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.544852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.544852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] PATH_INFO: `/v3/projects/628e516dad5d4be88df3b5a3203da2fe/users/4cdf4e219390400ea41387fc764dc5ed/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.546970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=628e516dad5d4be88df3b5a3203da2fe, user_id=4cdf4e219390400ea41387fc764dc5ed, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.549623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.559441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1286/2571] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:01:39 2022] PUT /identity/v3/projects/628e516dad5d4be88df3b5a3203da2fe/users/4cdf4e219390400ea41387fc764dc5ed/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:39.570294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec878-21a0-440e-88e1-c721a2d852eb None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.570583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec878-21a0-440e-88e1-c721a2d852eb None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.570858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec878-21a0-440e-88e1-c721a2d852eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.598803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-903ec878-21a0-440e-88e1-c721a2d852eb None None] MFA Rules not processed for user `4cdf4e219390400ea41387fc764dc5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:39.600017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-903ec878-21a0-440e-88e1-c721a2d852eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:39.646299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:39.667779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1286/2572] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:39.678953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.680753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:39.737550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2cea-a1b9-4252-b003-b7b79f56be26 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.741166 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c0534-f260-4dce-89a6-f06978458779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.741761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c0534-f260-4dce-89a6-f06978458779 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.742046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c0534-f260-4dce-89a6-f06978458779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.742319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c0534-f260-4dce-89a6-f06978458779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.751809 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c0534-f260-4dce-89a6-f06978458779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.753253 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c0534-f260-4dce-89a6-f06978458779 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.762831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1287/2573] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:39.835120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec878-21a0-440e-88e1-c721a2d852eb None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:39.845483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec878-21a0-440e-88e1-c721a2d852eb None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:39.849180 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:39.849806 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:39.850087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:39.850358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:39.905317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:39.907421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:39.916041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1287/2574] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:49.467244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b59fd-605a-463f-84e4-033eb4ea9195 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:49.467244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b59fd-605a-463f-84e4-033eb4ea9195 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:49.467244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b59fd-605a-463f-84e4-033eb4ea9195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:49.484318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-421b59fd-605a-463f-84e4-033eb4ea9195 None None] MFA Rules not processed for user `01b42bfd23334d4a8c477af08a178607`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:49.485876 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-421b59fd-605a-463f-84e4-033eb4ea9195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:49.541846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:49.558701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1288/2575] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:49.789134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:49.790620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:49.848787 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710843a-b12c-4998-8dc4-786492cd65c2 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:49.852671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0edb30-44f6-449e-927f-68e3de987b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:49.853277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edb30-44f6-449e-927f-68e3de987b8c service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:49.853562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edb30-44f6-449e-927f-68e3de987b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:49.853838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edb30-44f6-449e-927f-68e3de987b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:49.855562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0b0edb30-44f6-449e-927f-68e3de987b8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:49.865199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0edb30-44f6-449e-927f-68e3de987b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:49.866668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0edb30-44f6-449e-927f-68e3de987b8c service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:49.876034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1288/2576] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:54.758670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b59fd-605a-463f-84e4-033eb4ea9195 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:54.822247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b59fd-605a-463f-84e4-033eb4ea9195 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:54.826930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:54.827702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:54.828108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:54.828560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] PATH_INFO: `/v3/users/de706153edc34f9fa4234e0d1a63d06b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:54.829807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de706153edc34f9fa4234e0d1a63d06b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:54.831830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:54.880550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de706153edc34f9fa4234e0d1a63d06b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:54.881223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de706153edc34f9fa4234e0d1a63d06b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:54.881840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de706153edc34f9fa4234e0d1a63d06b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:54.889307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de706153edc34f9fa4234e0d1a63d06b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:54.896907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de706153edc34f9fa4234e0d1a63d06b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:54.914990 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1289/2577] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:01:54 2022] DELETE /identity/v3/users/de706153edc34f9fa4234e0d1a63d06b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:54.919781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:54.920291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:54.920438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:54.940176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:54.941435 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:55.007626 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1289/2578] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:55.020046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:55.021504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:55.083112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2c5f8-cb63-4def-9bdb-42f0b5bfa4a9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:55.087919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:55.088571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:55.088866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:55.089133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:55.099966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:55.101698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:55.112944 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1290/2579] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:55.358042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:55.358999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:55.439498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=100 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:55.519160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151647-6a37-448b-ba06-5055eb65c613 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:55.525849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:55.526483 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:55.526776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:55.527056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:55.529390 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:55.546034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:55.548940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:55.568660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1290/2580] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:55.772491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:55.774204 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:55.790681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2451ae2-228b-4791-907f-1245fe4609c7 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:55.796901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:55.797853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:55.798303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:55.798679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] PATH_INFO: `/v3/projects/705dfb0e8e614d21a1391e2caa3b7a07` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:55.800004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=705dfb0e8e614d21a1391e2caa3b7a07)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:55.802263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:55.849773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:55.899603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705dfb0e8e614d21a1391e2caa3b7a07', 'request_id': 'req-0ab45be3-42f2-42dd-9743-b3fc1c422f90'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:55.906824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705dfb0e8e614d21a1391e2caa3b7a07', 'request_id': 'req-0ab45be3-42f2-42dd-9743-b3fc1c422f90'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:55.915808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705dfb0e8e614d21a1391e2caa3b7a07', 'request_id': 'req-0ab45be3-42f2-42dd-9743-b3fc1c422f90'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:55.933308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] The token cache is being invalidate because project 705dfb0e8e614d21a1391e2caa3b7a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:01:55.933599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:55.934319 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:55.936301 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1291/2581] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:01:55 2022] DELETE /identity/v3/projects/705dfb0e8e614d21a1391e2caa3b7a07 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:55.941143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:55.955815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c723e-3721-4f3b-be5b-7f37b8e1a114 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:56.023150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:56.024103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.024408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.024729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] PATH_INFO: `/v3/users/4cdf4e219390400ea41387fc764dc5ed` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.026030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cdf4e219390400ea41387fc764dc5ed)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:56.027858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:56.083726 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cdf4e219390400ea41387fc764dc5ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.084467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cdf4e219390400ea41387fc764dc5ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.092874 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cdf4e219390400ea41387fc764dc5ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.093915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cdf4e219390400ea41387fc764dc5ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.103047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ed2a025e-8f71-416d-9578-4906f8338b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cdf4e219390400ea41387fc764dc5ed'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.123742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1291/2582] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:01:55 2022] DELETE /identity/v3/users/4cdf4e219390400ea41387fc764dc5ed => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:56.422996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:56.424543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:56.449734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab45be3-42f2-42dd-9743-b3fc1c422f90 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:56.539256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:56.539964 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.540278 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.540590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] PATH_INFO: `/v3/projects/628e516dad5d4be88df3b5a3203da2fe` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.541873 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628e516dad5d4be88df3b5a3203da2fe)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:56.543985 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:56.595818 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628e516dad5d4be88df3b5a3203da2fe', 'request_id': 'req-6cf159cf-43b7-4e4c-962e-761754826680'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.602379 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628e516dad5d4be88df3b5a3203da2fe', 'request_id': 'req-6cf159cf-43b7-4e4c-962e-761754826680'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.609154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628e516dad5d4be88df3b5a3203da2fe', 'request_id': 'req-6cf159cf-43b7-4e4c-962e-761754826680'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.620822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] The token cache is being invalidate because project 628e516dad5d4be88df3b5a3203da2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:01:56.621110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.621738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-6cf159cf-43b7-4e4c-962e-761754826680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:01:56.623434 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1292/2583] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:01:56 2022] DELETE /identity/v3/projects/628e516dad5d4be88df3b5a3203da2fe => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:56.628050 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6848a0-ff10-4482-a5c1-11c40854bd04 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.628436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6848a0-ff10-4482-a5c1-11c40854bd04 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.628650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6848a0-ff10-4482-a5c1-11c40854bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.647785 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ae6848a0-ff10-4482-a5c1-11c40854bd04 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:56.649025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ae6848a0-ff10-4482-a5c1-11c40854bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:56.677412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:56.724873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1292/2584] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:56.735753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8e01-49ca-48f0-be52-8776562970aa None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.736040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8e01-49ca-48f0-be52-8776562970aa None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.736345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e8e01-49ca-48f0-be52-8776562970aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.756230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-c55e8e01-49ca-48f0-be52-8776562970aa None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:56.757480 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-c55e8e01-49ca-48f0-be52-8776562970aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:56.765526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1293/2585] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:56.769826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6848a0-ff10-4482-a5c1-11c40854bd04 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:56.779550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6848a0-ff10-4482-a5c1-11c40854bd04 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:56.784750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:56.785440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.785783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.786146 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.786801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:01:56.787133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:56.788757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:56.801291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1293/2586] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:01:56.805591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8e01-49ca-48f0-be52-8776562970aa None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:56.814931 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e8e01-49ca-48f0-be52-8776562970aa None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:56.819485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:56.820090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.820367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.820676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.821299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:56.823552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:56.851795 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1294/2587] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:01:56 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:56.856212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:56.867500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69249b9-f5be-4a24-a2e9-c2b574b4a8c8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:56.926084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:56.927012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.927294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.927571 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.928213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:56.930178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:56.951216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1294/2588] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:01:56 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:01:56.955801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:56.965863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afa7a0-97cc-4e77-8072-87d81aa865df admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:56.971184 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:56.971785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:56.972064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:56.972336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:56.973022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:56.974598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:56.976190 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:56.990277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1295/2589] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:56.991466 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.002074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d282c2-b80f-4aad-bb0d-04fbf809515b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.006802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49d48b-b475-476d-bae0-db0e8242e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.007402 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d48b-b475-476d-bae0-db0e8242e8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.007686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d48b-b475-476d-bae0-db0e8242e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.007964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49d48b-b475-476d-bae0-db0e8242e8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.008645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49d48b-b475-476d-bae0-db0e8242e8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.010257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49d48b-b475-476d-bae0-db0e8242e8ba admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.021655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1295/2590] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:57.025905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.036966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d363d7-7a6b-4dd3-9e52-c8681d8f3020 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.041617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.042375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.042719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.043056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] PATH_INFO: `/v3/projects/a78dd9b3eaff4feba9eeaa06adbf3896/users/78246718854449fd9cbe185a11071a06/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.059767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78dd9b3eaff4feba9eeaa06adbf3896, user_id=78246718854449fd9cbe185a11071a06, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.062520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.076518 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1296/2591] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:01:57 2022] PUT /identity/v3/projects/a78dd9b3eaff4feba9eeaa06adbf3896/users/78246718854449fd9cbe185a11071a06/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:57.087504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ca00-9340-4731-8018-540dae11be23 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.087886 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ca00-9340-4731-8018-540dae11be23 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.088231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ca00-9340-4731-8018-540dae11be23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.117241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-90f3ca00-9340-4731-8018-540dae11be23 None None] MFA Rules not processed for user `78246718854449fd9cbe185a11071a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:57.118400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-90f3ca00-9340-4731-8018-540dae11be23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:57.187289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1296/2592] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:57 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:57.192449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.260130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac380c-cc3c-4945-b4b9-e6f651166fbb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.264930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.265569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.266472 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.266752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.267390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.269316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.295641 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1297/2593] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:01:57 2022] POST /identity/v3/projects => generated 407 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:57.299939 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ca00-9340-4731-8018-540dae11be23 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.311002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ca00-9340-4731-8018-540dae11be23 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.336257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:57.369842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.370442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.370727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.371000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.371614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.373625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.395082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1297/2594] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:01:57 2022] POST /identity/v3/users => generated 310 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:01:57.399422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.409687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63d78b-4788-439b-ae5b-c4b59d1e8038 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.414297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.414894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.415195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.415453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.416095 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.417742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.427992 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1298/2595] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:57.432043 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.442314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb00c41-f7b9-4dd4-b8af-e0866fcde310 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.446973 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.447625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.447910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.448186 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] PATH_INFO: `/v3/projects/c33663d087264d93be82441b33178be9/users/f821ffb8f26b4d6cbb657c5816be1593/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.464375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33663d087264d93be82441b33178be9, user_id=f821ffb8f26b4d6cbb657c5816be1593, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.467061 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.479919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1298/2596] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:01:57 2022] PUT /identity/v3/projects/c33663d087264d93be82441b33178be9/users/f821ffb8f26b4d6cbb657c5816be1593/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:57.483938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.493880 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5d736-f251-4ba2-a110-7b84d5c99cbc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.550353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122def6-f393-43ce-98ae-507bcfaea9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.550962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122def6-f393-43ce-98ae-507bcfaea9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.551263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122def6-f393-43ce-98ae-507bcfaea9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.551521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122def6-f393-43ce-98ae-507bcfaea9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.552162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122def6-f393-43ce-98ae-507bcfaea9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.553827 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122def6-f393-43ce-98ae-507bcfaea9cb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.563940 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1299/2597] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:01:57.568031 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.580504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567f03c-fd89-4d9c-8411-4c1b1eabcab7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.585014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.585711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.586108 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.586896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] PATH_INFO: `/v3/projects/c33663d087264d93be82441b33178be9/users/f821ffb8f26b4d6cbb657c5816be1593/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.589450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33663d087264d93be82441b33178be9, user_id=f821ffb8f26b4d6cbb657c5816be1593, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.592334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.603209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1299/2598] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:01:57 2022] PUT /identity/v3/projects/c33663d087264d93be82441b33178be9/users/f821ffb8f26b4d6cbb657c5816be1593/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:01:57.614977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aed99-4f35-4a3f-a99b-38421f872bdb None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.615349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aed99-4f35-4a3f-a99b-38421f872bdb None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.615693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aed99-4f35-4a3f-a99b-38421f872bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.644098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a44aed99-4f35-4a3f-a99b-38421f872bdb None None] MFA Rules not processed for user `f821ffb8f26b4d6cbb657c5816be1593`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:01:57.645251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a44aed99-4f35-4a3f-a99b-38421f872bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:57.676134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:57.716445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1300/2599] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:01:57 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:01:57.727764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.729599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:57.792602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c4fdf-0d16-4324-a5a8-9987314341f7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.796497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.797634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.797911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.798182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:57.807375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:57.808869 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:57.818878 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1300/2600] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:57 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:57.963389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aed99-4f35-4a3f-a99b-38421f872bdb None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:57.973417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aed99-4f35-4a3f-a99b-38421f872bdb None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:57.977244 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:57.977845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:57.978128 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:57.978413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:58.037230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:58.038670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:58.047929 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1301/2601] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:57 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:01:59.599641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:01:59.601561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:59.658938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77c37d-6c77-4888-bd2c-1c6bd21f9616 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:01:59.662403 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:01:59.663006 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:01:59.663288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:01:59.663560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:01:59.665305 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:01:59.699835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:01:59.732083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:01:59.733582 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:01:59.743333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1301/2602] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:03.060057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.061629 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:03.079344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc502e32-c777-492f-8dae-c94733280101 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.084543 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:03.085173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.085554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.085901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] PATH_INFO: `/v3/users/a42d659ce7bb4946bd082a07d9339e4e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.087297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42d659ce7bb4946bd082a07d9339e4e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:03.089281 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:03.137954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42d659ce7bb4946bd082a07d9339e4e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.138568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42d659ce7bb4946bd082a07d9339e4e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.139228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42d659ce7bb4946bd082a07d9339e4e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.146592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42d659ce7bb4946bd082a07d9339e4e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.154348 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42d659ce7bb4946bd082a07d9339e4e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.174094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1302/2603] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:03 2022] DELETE /identity/v3/users/a42d659ce7bb4946bd082a07d9339e4e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:03.354384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.365187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79da3d-ffaa-4c74-ac75-a27234b4f574 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.441497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:03.442137 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.442425 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.442812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] PATH_INFO: `/v3/projects/1c90722aa00a44e2a945372c5a51d93d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.443945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c90722aa00a44e2a945372c5a51d93d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:03.445927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:03.461452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.462900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:03.477620 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637bdda1-cae1-4bc9-8faa-71ac84d6e03e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.482812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:03.483446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.483728 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.484567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] PATH_INFO: `/v3/users/78246718854449fd9cbe185a11071a06` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.485701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78246718854449fd9cbe185a11071a06)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:03.487618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:03.498359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c90722aa00a44e2a945372c5a51d93d', 'request_id': 'req-5854d4c5-77c1-43e3-901e-a46ddd5577ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.506115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c90722aa00a44e2a945372c5a51d93d', 'request_id': 'req-5854d4c5-77c1-43e3-901e-a46ddd5577ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.512861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c90722aa00a44e2a945372c5a51d93d', 'request_id': 'req-5854d4c5-77c1-43e3-901e-a46ddd5577ec'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.528779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] The token cache is being invalidate because project 1c90722aa00a44e2a945372c5a51d93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:03.529159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:03.529629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.530515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-5854d4c5-77c1-43e3-901e-a46ddd5577ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.533041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1302/2604] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:03 2022] DELETE /identity/v3/projects/1c90722aa00a44e2a945372c5a51d93d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:03.538554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d293a88-d03c-4211-be98-8d643c675e21 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.539093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d293a88-d03c-4211-be98-8d643c675e21 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.539538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d293a88-d03c-4211-be98-8d643c675e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.546424 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78246718854449fd9cbe185a11071a06'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.547642 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78246718854449fd9cbe185a11071a06'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.548264 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78246718854449fd9cbe185a11071a06'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.557703 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78246718854449fd9cbe185a11071a06'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.562610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4d293a88-d03c-4211-be98-8d643c675e21 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:03.563812 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4d293a88-d03c-4211-be98-8d643c675e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:03.565994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-bbd0b777-5527-4779-8bb3-9dcd232a1917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78246718854449fd9cbe185a11071a06'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:03.590374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1303/2605] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:03 2022] DELETE /identity/v3/users/78246718854449fd9cbe185a11071a06 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:03.595421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.595722 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.596124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.615199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:03.616487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:03.626729 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1303/2606] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:03.634528 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689340-30ab-4ccc-98c8-a7e83c4dcabd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.634815 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689340-30ab-4ccc-98c8-a7e83c4dcabd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.635093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15689340-30ab-4ccc-98c8-a7e83c4dcabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.643100 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:03.658022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-15689340-30ab-4ccc-98c8-a7e83c4dcabd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:03.659216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-15689340-30ab-4ccc-98c8-a7e83c4dcabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:03.678100 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1304/2607] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:03.688006 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.689384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:03.717902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1304/2608] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:03.722618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689340-30ab-4ccc-98c8-a7e83c4dcabd None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.731511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15689340-30ab-4ccc-98c8-a7e83c4dcabd None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.736438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:03.737133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.737413 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.737689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.738333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:03.738632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:03.740229 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:03.748136 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a568707-0ada-4a0d-b122-b4d51283f70d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.751772 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:03.751908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1305/2609] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:02:03.752396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.752710 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.752986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.756203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.762368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:03.763861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:03.766298 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2a24c-bc6f-4dd2-ba8b-2a785f206386 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.770902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:03.771471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.771777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.772046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.772679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:03.774221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1305/2610] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:02:03.774545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:03.810621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1306/2611] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:03 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:02:03.815053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.827444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90616d47-9bad-4186-92db-688bf5e0343c service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.895413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:03.910567 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:03.911792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:03.911947 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:03.912321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:03.913449 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:03.918459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:03.954961 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1306/2612] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:03 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:03.956379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:03.984825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755dee2-6fab-445b-aa6a-dbb17be6f332 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:03.999007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:04.000109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.000423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.000710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.001998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:04.004045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:04.015924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1307/2613] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:04.019608 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:04.030586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d30d78-402c-4d0a-9a6e-3f6d9cda0abf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:04.035816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c867420-1dd2-4ef9-9302-8c7e283727eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:04.036485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867420-1dd2-4ef9-9302-8c7e283727eb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.036766 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867420-1dd2-4ef9-9302-8c7e283727eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.037046 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867420-1dd2-4ef9-9302-8c7e283727eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.037699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c867420-1dd2-4ef9-9302-8c7e283727eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:04.039364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c867420-1dd2-4ef9-9302-8c7e283727eb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:04.053260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1307/2614] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:04.054817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:04.068253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54df540-30de-4fbe-93f7-ffbece7cd9ec admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:04.074452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:04.075118 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.075399 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.075672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] PATH_INFO: `/v3/projects/5d3e88979eca417a981aa360d97df660/users/a14d333bdc4d4a1d870ecafca4a926aa/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.091415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3e88979eca417a981aa360d97df660, user_id=a14d333bdc4d4a1d870ecafca4a926aa, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:04.094166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:04.108468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1308/2615] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:04 2022] PUT /identity/v3/projects/5d3e88979eca417a981aa360d97df660/users/a14d333bdc4d4a1d870ecafca4a926aa/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:04.114018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a700b2-7063-446e-b94f-a56bfe416aef None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.114581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a700b2-7063-446e-b94f-a56bfe416aef None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.114775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a700b2-7063-446e-b94f-a56bfe416aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.119657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:04.121843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:04.134853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-05a700b2-7063-446e-b94f-a56bfe416aef None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:04.136105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-05a700b2-7063-446e-b94f-a56bfe416aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:04.191707 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321205b-1e20-408b-b0c5-ec232e5d77c5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:04.196357 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:04.197009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.197287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.197562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] PATH_INFO: `/v3/projects/a78dd9b3eaff4feba9eeaa06adbf3896` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.198684 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78dd9b3eaff4feba9eeaa06adbf3896)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:04.200585 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1308/2616] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:04.200758 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:04.211340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a700b2-7063-446e-b94f-a56bfe416aef None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:04.239084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:04.251410 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78dd9b3eaff4feba9eeaa06adbf3896', 'request_id': 'req-ec03f725-a550-45f4-bbe4-13645bc10113'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.257046 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78dd9b3eaff4feba9eeaa06adbf3896', 'request_id': 'req-ec03f725-a550-45f4-bbe4-13645bc10113'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.263185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78dd9b3eaff4feba9eeaa06adbf3896', 'request_id': 'req-ec03f725-a550-45f4-bbe4-13645bc10113'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.268171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a700b2-7063-446e-b94f-a56bfe416aef None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:04.276419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] The token cache is being invalidate because project a78dd9b3eaff4feba9eeaa06adbf3896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:04.276718 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.277349 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.278837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1309/2617] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:04 2022] DELETE /identity/v3/projects/a78dd9b3eaff4feba9eeaa06adbf3896 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:04.282735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:04.284202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:04.320637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:04.321249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.321526 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.321797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.323552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:04.349346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03f725-a550-45f4-bbe4-13645bc10113 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:04.354326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:04.354952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.355490 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.355616 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] PATH_INFO: `/v3/users/f821ffb8f26b4d6cbb657c5816be1593` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.356764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f821ffb8f26b4d6cbb657c5816be1593)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:04.358691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:04.379564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:04.403942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:04.405723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:04.408749 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f821ffb8f26b4d6cbb657c5816be1593'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.409622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f821ffb8f26b4d6cbb657c5816be1593'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.415836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1309/2618] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:02:04.418074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f821ffb8f26b4d6cbb657c5816be1593'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.418767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f821ffb8f26b4d6cbb657c5816be1593'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.427730 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2c70970b-7ed8-473d-af5c-318d65474064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f821ffb8f26b4d6cbb657c5816be1593'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.449161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1310/2619] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:04 2022] DELETE /identity/v3/users/f821ffb8f26b4d6cbb657c5816be1593 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:04.742572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:04.753349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaac86-a4b2-44f4-8480-1884d85078d2 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:04.835761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:04.836828 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.837177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.837529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] PATH_INFO: `/v3/projects/c33663d087264d93be82441b33178be9` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.838761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33663d087264d93be82441b33178be9)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:04.841038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:04.895705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33663d087264d93be82441b33178be9', 'request_id': 'req-04e695f5-7a50-408b-8436-853aa1232425'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.901755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33663d087264d93be82441b33178be9', 'request_id': 'req-04e695f5-7a50-408b-8436-853aa1232425'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.909556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33663d087264d93be82441b33178be9', 'request_id': 'req-04e695f5-7a50-408b-8436-853aa1232425'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.920950 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] The token cache is being invalidate because project c33663d087264d93be82441b33178be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:04.921265 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.922569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-04e695f5-7a50-408b-8436-853aa1232425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:04.924064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1310/2620] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:04 2022] DELETE /identity/v3/projects/c33663d087264d93be82441b33178be9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:04.929204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e4a9-0952-4a43-a427-628bea542072 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:04.929500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e4a9-0952-4a43-a427-628bea542072 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:04.929779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e4a9-0952-4a43-a427-628bea542072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:04.951177 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4e02e4a9-0952-4a43-a427-628bea542072 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:04.952421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4e02e4a9-0952-4a43-a427-628bea542072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:04.994587 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:05.039977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1311/2621] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:05.041391 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d387d-038c-4f67-97ca-f2cc012936d2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.041715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d387d-038c-4f67-97ca-f2cc012936d2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.041966 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d387d-038c-4f67-97ca-f2cc012936d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.080314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-300d387d-038c-4f67-97ca-f2cc012936d2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:05.081684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-300d387d-038c-4f67-97ca-f2cc012936d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:05.102596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1311/2622] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:05.103553 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02e4a9-0952-4a43-a427-628bea542072 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.117343 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02e4a9-0952-4a43-a427-628bea542072 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.126716 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.127777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.128612 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.129103 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.130172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:05.131127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.133824 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.164192 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1312/2623] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:02:05.166865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d387d-038c-4f67-97ca-f2cc012936d2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.178223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d387d-038c-4f67-97ca-f2cc012936d2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.183446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.184084 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.184370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.184677 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.185325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.187396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.223194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1312/2624] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:05 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:05.227762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.239370 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c1dc3-7e5c-423e-8a43-be27c7c4876a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.343092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080892b2-0b6a-498a-98c0-5fb5f5be444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.344723 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080892b2-0b6a-498a-98c0-5fb5f5be444e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.345012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080892b2-0b6a-498a-98c0-5fb5f5be444e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.345772 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080892b2-0b6a-498a-98c0-5fb5f5be444e admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.346855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080892b2-0b6a-498a-98c0-5fb5f5be444e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.349190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080892b2-0b6a-498a-98c0-5fb5f5be444e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.379090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1313/2625] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:05 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:05.383329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.384217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52a2e1-33af-445e-81f8-d48613c72ae6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.384698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52a2e1-33af-445e-81f8-d48613c72ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.385156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52a2e1-33af-445e-81f8-d48613c72ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.397638 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97199087-8a27-42af-b09c-06c8ec99907a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.404995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.407104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.407392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.407853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.409597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9d52a2e1-33af-445e-81f8-d48613c72ae6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:05.409799 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.411141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9d52a2e1-33af-445e-81f8-d48613c72ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:05.411634 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.421277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1314/2626] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:05.425977 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1313/2627] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:05.429853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52a2e1-33af-445e-81f8-d48613c72ae6 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.443740 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.445954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:05.447224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52a2e1-33af-445e-81f8-d48613c72ae6 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.453243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.453905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.454191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.454467 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.455679 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.457360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.471694 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1315/2628] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:05.473182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.485891 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f816d5c-e573-411a-acec-845cbbaa46d1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.492174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:05.493235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d087d2-3276-4012-b548-fd97349cbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.493923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d087d2-3276-4012-b548-fd97349cbd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.494213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d087d2-3276-4012-b548-fd97349cbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.494636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d087d2-3276-4012-b548-fd97349cbd47 admin admin] PATH_INFO: `/v3/projects/ef2a3ad887414f539e4c5d644199b094/users/98f567a5dc8c4a7d8b5f3961680f6146/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.514656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d087d2-3276-4012-b548-fd97349cbd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2a3ad887414f539e4c5d644199b094, user_id=98f567a5dc8c4a7d8b5f3961680f6146, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.518059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d087d2-3276-4012-b548-fd97349cbd47 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.547525 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1316/2629] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:05 2022] PUT /identity/v3/projects/ef2a3ad887414f539e4c5d644199b094/users/98f567a5dc8c4a7d8b5f3961680f6146/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:05.549905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29485473-db55-4482-9980-41cdd315d486 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.550160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29485473-db55-4482-9980-41cdd315d486 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.550442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29485473-db55-4482-9980-41cdd315d486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.567120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949bde-ff71-48de-933e-dee52b3988f2 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.591335 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-29485473-db55-4482-9980-41cdd315d486 None None] MFA Rules not processed for user `98f567a5dc8c4a7d8b5f3961680f6146`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:05.592830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-29485473-db55-4482-9980-41cdd315d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:05.680662 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1317/2630] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:05.685629 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29485473-db55-4482-9980-41cdd315d486 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.698283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:05.790826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29485473-db55-4482-9980-41cdd315d486 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.794333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.795309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.795811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.796269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.797415 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.798043 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.798353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.798603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.799248 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.801319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.814793 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.820284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.839945 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1314/2631] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:05.849506 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1318/2632] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:05 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:05.854687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:05.873474 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978aa5a5-92f9-417a-adcd-958eeb183030 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:05.961734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:05.962566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:05.963081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:05.963547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:05.964465 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:05.966541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:05.991599 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1315/2633] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:05 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:05.995699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:06.014420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42418f9-a11c-4364-9295-c5852d1ad75b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:06.021294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:06.024634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:06.025033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:06.025531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:06.035635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:06.038304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:06.053828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1319/2634] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:06.058107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:06.070378 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d753c-efc4-419a-9137-c530ebf1da65 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:06.075525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:06.076198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:06.076505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:06.076777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] PATH_INFO: `/v3/projects/5c9d58c1f699490ea160d6a84348cec2/users/afb064ebeaed4b14baae8a44cf8a90aa/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:06.094181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9d58c1f699490ea160d6a84348cec2, user_id=afb064ebeaed4b14baae8a44cf8a90aa, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:06.096901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:06.112487 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1316/2635] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:06 2022] PUT /identity/v3/projects/5c9d58c1f699490ea160d6a84348cec2/users/afb064ebeaed4b14baae8a44cf8a90aa/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:06.116567 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:06.127149 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb8482-a8ad-4243-b1ab-8bfb585ff093 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:06.223940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b69c8c-0b45-43fa-a65d-83875ce1626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:06.225946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69c8c-0b45-43fa-a65d-83875ce1626c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:06.225946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69c8c-0b45-43fa-a65d-83875ce1626c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:06.227444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69c8c-0b45-43fa-a65d-83875ce1626c admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:06.227444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b69c8c-0b45-43fa-a65d-83875ce1626c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:06.228922 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b69c8c-0b45-43fa-a65d-83875ce1626c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:06.240808 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1320/2636] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:06.244928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:06.256238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777ca8-7c2e-405b-ac3c-959293bf39fe admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:06.266116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:06.266973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:06.267357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:06.267739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] PATH_INFO: `/v3/projects/5c9d58c1f699490ea160d6a84348cec2/users/afb064ebeaed4b14baae8a44cf8a90aa/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:06.270003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9d58c1f699490ea160d6a84348cec2, user_id=afb064ebeaed4b14baae8a44cf8a90aa, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:06.273393 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:06.291221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1317/2637] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:06 2022] PUT /identity/v3/projects/5c9d58c1f699490ea160d6a84348cec2/users/afb064ebeaed4b14baae8a44cf8a90aa/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:06.303766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddea65-945a-4612-9068-e8ef1adbb17c None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:06.304193 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddea65-945a-4612-9068-e8ef1adbb17c None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:06.304709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddea65-945a-4612-9068-e8ef1adbb17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:06.342985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-04ddea65-945a-4612-9068-e8ef1adbb17c None None] MFA Rules not processed for user `afb064ebeaed4b14baae8a44cf8a90aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:06.344670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-04ddea65-945a-4612-9068-e8ef1adbb17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:06.419047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1321/2638] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:06.429702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:06.431428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:06.438430 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:06.494664 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43b1b3-e379-4f93-adc9-b55ae303b60f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:06.498307 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f34e9-a2f2-4855-ab95-444a81dd7f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:06.499041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f34e9-a2f2-4855-ab95-444a81dd7f3d service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:06.499857 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f34e9-a2f2-4855-ab95-444a81dd7f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:06.500159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f34e9-a2f2-4855-ab95-444a81dd7f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:06.509616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f34e9-a2f2-4855-ab95-444a81dd7f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:06.511028 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f34e9-a2f2-4855-ab95-444a81dd7f3d service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:06.521143 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1318/2639] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:07.270695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddea65-945a-4612-9068-e8ef1adbb17c None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:07.275249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:07.363972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddea65-945a-4612-9068-e8ef1adbb17c None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:07.369404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:07.370401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:07.370844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:07.371286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] PATH_INFO: `/v3/users/98f567a5dc8c4a7d8b5f3961680f6146` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:07.372762 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f567a5dc8c4a7d8b5f3961680f6146)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:07.376066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:07.445664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f567a5dc8c4a7d8b5f3961680f6146'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:07.446441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f567a5dc8c4a7d8b5f3961680f6146'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:07.460600 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f567a5dc8c4a7d8b5f3961680f6146'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:07.461488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f567a5dc8c4a7d8b5f3961680f6146'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:07.471658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f567a5dc8c4a7d8b5f3961680f6146'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:07.508412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1322/2640] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:07 2022] DELETE /identity/v3/users/98f567a5dc8c4a7d8b5f3961680f6146 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:07.512812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:07.513327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:07.514420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:07.541400 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:07.543169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:07.641771 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1319/2641] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:07.651655 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:07.653368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:07.725978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b15c5-7caa-4c63-abb9-d81e21e5cd01 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:07.729896 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:07.730733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:07.731202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:07.731554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:07.743090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:07.744704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:07.764698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1323/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:08.148073 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:08.150831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:08.169490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190ddfd-c1a4-4346-a135-04d6edaeee15 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:08.183052 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:08.184051 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:08.184592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:08.185021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] PATH_INFO: `/v3/projects/ef2a3ad887414f539e4c5d644199b094` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:08.186345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2a3ad887414f539e4c5d644199b094)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:08.188520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:08.266735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2a3ad887414f539e4c5d644199b094', 'request_id': 'req-243915bf-4d14-4e01-8973-d525380e30fb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.275666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2a3ad887414f539e4c5d644199b094', 'request_id': 'req-243915bf-4d14-4e01-8973-d525380e30fb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.289198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2a3ad887414f539e4c5d644199b094', 'request_id': 'req-243915bf-4d14-4e01-8973-d525380e30fb'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.304341 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] The token cache is being invalidate because project ef2a3ad887414f539e4c5d644199b094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:08.305063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.305904 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-243915bf-4d14-4e01-8973-d525380e30fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.313510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:08.314009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1320/2643] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:08 2022] DELETE /identity/v3/projects/ef2a3ad887414f539e4c5d644199b094 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:08.325286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e92b94-dbdc-4d2c-b36a-2a9da3679fdd service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:08.354531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:08.405441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:08.407591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:08.408130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:08.409250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] PATH_INFO: `/v3/users/afb064ebeaed4b14baae8a44cf8a90aa` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:08.417321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb064ebeaed4b14baae8a44cf8a90aa)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:08.419639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:08.495945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb064ebeaed4b14baae8a44cf8a90aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.496982 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb064ebeaed4b14baae8a44cf8a90aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.506451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb064ebeaed4b14baae8a44cf8a90aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.507407 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb064ebeaed4b14baae8a44cf8a90aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.519202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb064ebeaed4b14baae8a44cf8a90aa'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:08.568524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1324/2644] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:08 2022] DELETE /identity/v3/users/afb064ebeaed4b14baae8a44cf8a90aa => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:08.799520 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:08.800417 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:08.800848 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:08.839624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:08.840907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:08.895709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:08.931099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:08.932632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:08.954846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1321/2645] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:08.976949 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:08.979058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:09.038493 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5e0c8-5999-41bb-8fd6-6a19be173f2d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.045279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.046301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.047461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.047825 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] PATH_INFO: `/v3/projects/5c9d58c1f699490ea160d6a84348cec2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.049695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9d58c1f699490ea160d6a84348cec2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.052021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.084988 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa217-07f3-4183-8f58-ce92d986e94b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.094646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfcc9f-b8b8-4b30-bca8-8bd0a2a78929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.095339 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfcc9f-b8b8-4b30-bca8-8bd0a2a78929 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.098715 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfcc9f-b8b8-4b30-bca8-8bd0a2a78929 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.099302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfcc9f-b8b8-4b30-bca8-8bd0a2a78929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.120303 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfcc9f-b8b8-4b30-bca8-8bd0a2a78929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.122023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfcc9f-b8b8-4b30-bca8-8bd0a2a78929 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.129166 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:09.132706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9d58c1f699490ea160d6a84348cec2', 'request_id': 'req-2d0b3bda-2554-491b-8065-f770edff4dc3'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:09.135467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1322/2646] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:09.136670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.137014 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.137282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.143098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9d58c1f699490ea160d6a84348cec2', 'request_id': 'req-2d0b3bda-2554-491b-8065-f770edff4dc3'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:09.150942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9d58c1f699490ea160d6a84348cec2', 'request_id': 'req-2d0b3bda-2554-491b-8065-f770edff4dc3'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:09.181767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] MFA Rules not processed for user `a14d333bdc4d4a1d870ecafca4a926aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:09.183065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:09.190102 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] The token cache is being invalidate because project 5c9d58c1f699490ea160d6a84348cec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:09.190532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:09.191319 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2d0b3bda-2554-491b-8065-f770edff4dc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:09.196906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1325/2647] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:08 2022] DELETE /identity/v3/projects/5c9d58c1f699490ea160d6a84348cec2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:09.214953 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fbffb-79fb-4e34-9bca-271f779a75fd None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.215531 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fbffb-79fb-4e34-9bca-271f779a75fd None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.216076 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fbffb-79fb-4e34-9bca-271f779a75fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.255752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-bb7fbffb-79fb-4e34-9bca-271f779a75fd None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:09.256450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bb7fbffb-79fb-4e34-9bca-271f779a75fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:09.310091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1323/2648] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:09.326924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.329435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:09.343943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1326/2649] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:09.351963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cbd5a-b85c-4ce9-b251-18bd1575e7e2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.352255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cbd5a-b85c-4ce9-b251-18bd1575e7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.352574 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cbd5a-b85c-4ce9-b251-18bd1575e7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.375560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b90cbd5a-b85c-4ce9-b251-18bd1575e7e2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:09.376833 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b90cbd5a-b85c-4ce9-b251-18bd1575e7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:09.385318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1327/2650] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:09.389560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cbd5a-b85c-4ce9-b251-18bd1575e7e2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.399015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=100 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:09.399938 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cbd5a-b85c-4ce9-b251-18bd1575e7e2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.407059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.408065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.408450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.408817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.409485 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:09.410028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.411656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.425222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1328/2651] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:02:09.429504 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.429651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6a891-bb98-4991-b6af-570d18ef0d71 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.435834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.436503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.437314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.437588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.441002 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8a1c-c9f6-442c-b378-56cb86c8ee5f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.446178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.447042 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.447659 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.447771 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.448087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.448374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.449039 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.451041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.458370 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1324/2652] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:09.484454 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1329/2653] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:09 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:02:09.486231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.498273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b14ff1-c406-4fe2-9356-2972acd5e9dd service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.579698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.579698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.580283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.580538 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.581200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.583568 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.611792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1325/2654] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:09 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:09.616209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.627614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284649f-7ab8-4e32-a145-cceafee0c074 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.632935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.633577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.633867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.634289 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.634956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.637088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.648842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1330/2655] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:02:09.653258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.663109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54885a9e-352f-4674-903d-b78ea2a2f5da admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.667852 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2be8a-0a2e-4be0-ad96-a64f21ce8708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.668504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2be8a-0a2e-4be0-ad96-a64f21ce8708 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.668782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2be8a-0a2e-4be0-ad96-a64f21ce8708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.669057 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2be8a-0a2e-4be0-ad96-a64f21ce8708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.669733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2be8a-0a2e-4be0-ad96-a64f21ce8708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.671882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2be8a-0a2e-4be0-ad96-a64f21ce8708 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.687491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1326/2656] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:09.690384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.703199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b02256-03ec-4265-ab0b-0f9ef7ee0626 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:09.709583 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:09.710408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.711200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.711200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] PATH_INFO: `/v3/projects/2ccfddd3b0e54791b89f3f26300aae78/users/14a9a8d24ace49ef881b57f8db3aa826/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.734866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccfddd3b0e54791b89f3f26300aae78, user_id=14a9a8d24ace49ef881b57f8db3aa826, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:09.738027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:09.754502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1331/2657] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:09 2022] PUT /identity/v3/projects/2ccfddd3b0e54791b89f3f26300aae78/users/14a9a8d24ace49ef881b57f8db3aa826/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:09.765496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fcd1-0d12-4a1c-81b4-5b5cfeb50dd9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:09.765894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fcd1-0d12-4a1c-81b4-5b5cfeb50dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:09.766260 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85fcd1-0d12-4a1c-81b4-5b5cfeb50dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:09.815194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3f85fcd1-0d12-4a1c-81b4-5b5cfeb50dd9 None None] MFA Rules not processed for user `14a9a8d24ace49ef881b57f8db3aa826`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:09.816971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3f85fcd1-0d12-4a1c-81b4-5b5cfeb50dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:09.925239 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1327/2658] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:09.939617 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:09.942068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:10.064524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b76a29-7dfa-400e-b444-a2b243555aa6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:10.068754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721ab1b-cb82-4556-828f-64d32c56e23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:10.069451 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ab1b-cb82-4556-828f-64d32c56e23e service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:10.069811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ab1b-cb82-4556-828f-64d32c56e23e service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:10.070162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ab1b-cb82-4556-828f-64d32c56e23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:10.081053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721ab1b-cb82-4556-828f-64d32c56e23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:10.083130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721ab1b-cb82-4556-828f-64d32c56e23e service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:10.087780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:10.093627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1332/2659] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:10.130995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fcd1-0d12-4a1c-81b4-5b5cfeb50dd9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:10.179235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:10.201062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85fcd1-0d12-4a1c-81b4-5b5cfeb50dd9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:10.205512 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:10.206147 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:10.206429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:10.206702 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] PATH_INFO: `/v3/users/14a9a8d24ace49ef881b57f8db3aa826` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:10.207816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a9a8d24ace49ef881b57f8db3aa826)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:10.209773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:10.261859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a9a8d24ace49ef881b57f8db3aa826'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.262618 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a9a8d24ace49ef881b57f8db3aa826'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.263560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a9a8d24ace49ef881b57f8db3aa826'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.284875 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a9a8d24ace49ef881b57f8db3aa826'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.293698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a9a8d24ace49ef881b57f8db3aa826'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.312475 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1328/2660] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:10 2022] DELETE /identity/v3/users/14a9a8d24ace49ef881b57f8db3aa826 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:10.317150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:10.317440 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:10.317757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:10.337745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:10.338955 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:10.414295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1333/2661] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:10.425279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:10.426822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:10.507249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f9088-8e02-429d-8f75-f5766af48890 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:10.512173 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf4a4c-f85e-451d-8d1b-cfee2dd5999a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:10.513382 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4a4c-f85e-451d-8d1b-cfee2dd5999a service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:10.513670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4a4c-f85e-451d-8d1b-cfee2dd5999a service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:10.514074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4a4c-f85e-451d-8d1b-cfee2dd5999a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:10.528699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf4a4c-f85e-451d-8d1b-cfee2dd5999a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:10.530273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf4a4c-f85e-451d-8d1b-cfee2dd5999a service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:10.544573 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1329/2662] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:10.852338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:10.854494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:10.874997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8df62-b13b-4d80-9d66-43f016807fb5 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:10.880080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:10.882024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:10.882318 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:10.882582 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] PATH_INFO: `/v3/projects/2ccfddd3b0e54791b89f3f26300aae78` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:10.883916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccfddd3b0e54791b89f3f26300aae78)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:10.887576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:10.907088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c722a1-8862-4643-b964-3a38af3b8404 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:10.907600 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c722a1-8862-4643-b964-3a38af3b8404 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:10.907694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c722a1-8862-4643-b964-3a38af3b8404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:10.929648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-05c722a1-8862-4643-b964-3a38af3b8404 None None] MFA Rules not processed for user `a14d333bdc4d4a1d870ecafca4a926aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:10.931001 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-05c722a1-8862-4643-b964-3a38af3b8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:10.951917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccfddd3b0e54791b89f3f26300aae78', 'request_id': 'req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.959204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccfddd3b0e54791b89f3f26300aae78', 'request_id': 'req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.966433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccfddd3b0e54791b89f3f26300aae78', 'request_id': 'req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.981926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] The token cache is being invalidate because project 2ccfddd3b0e54791b89f3f26300aae78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:10.982210 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.982841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-6a9a0695-4434-46dd-b821-0c7a99d1e6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:10.984632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1334/2663] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:10 2022] DELETE /identity/v3/projects/2ccfddd3b0e54791b89f3f26300aae78 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:10.988999 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84033a-5c96-4c03-83b7-7d0fab1f9e52 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:10.989288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84033a-5c96-4c03-83b7-7d0fab1f9e52 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:10.989568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84033a-5c96-4c03-83b7-7d0fab1f9e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:10.997344 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1330/2664] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:11.011356 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4e84033a-5c96-4c03-83b7-7d0fab1f9e52 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:11.012598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4e84033a-5c96-4c03-83b7-7d0fab1f9e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:11.088792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1335/2665] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:11.097615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dbe69-e57c-437e-943c-153e3d438ac9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.097905 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dbe69-e57c-437e-943c-153e3d438ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.098182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dbe69-e57c-437e-943c-153e3d438ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.113148 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:11.119425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4d8dbe69-e57c-437e-943c-153e3d438ac9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:11.121561 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4d8dbe69-e57c-437e-943c-153e3d438ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:11.131770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1331/2666] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:11.135735 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84033a-5c96-4c03-83b7-7d0fab1f9e52 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.146168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84033a-5c96-4c03-83b7-7d0fab1f9e52 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.150998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.151632 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.151916 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.152196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.152893 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:11.153200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.154820 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.169609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1336/2667] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:02:11.174454 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dbe69-e57c-437e-943c-153e3d438ac9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.185893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dbe69-e57c-437e-943c-153e3d438ac9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.192452 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.193351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.193637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.193916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.194597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.196892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.232541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1332/2668] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:11 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:02:11.235112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.245510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195f6df-957c-44a1-b0e7-82874f81e47c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.261529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:11.315227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.316181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.316986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.317226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.317961 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.319940 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.349622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1337/2669] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:11 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:11.354275 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.362304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.365008 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:11.366718 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f8ceb-e87e-4743-99df-0941dc023ccc admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.373709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.375209 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.375716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.376229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.377016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.378806 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.393170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1333/2670] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:11.394925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.405167 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737cb8a-1d24-48ac-be61-569572a3a696 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.411296 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.412013 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.412353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.412736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.413451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.415481 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.425974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28680013-e321-43ea-ad48-9531b41684c3 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.427592 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1334/2671] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:11.430550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd6daf-5194-4afd-92d4-37c6bb61fb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.430881 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd6daf-5194-4afd-92d4-37c6bb61fb9d service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.431162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd6daf-5194-4afd-92d4-37c6bb61fb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.431399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.431527 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd6daf-5194-4afd-92d4-37c6bb61fb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.433275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c6dd6daf-5194-4afd-92d4-37c6bb61fb9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:11.442151 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f74f95-9786-4c1f-93f4-310eadb96beb admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.444654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd6daf-5194-4afd-92d4-37c6bb61fb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.446392 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd6daf-5194-4afd-92d4-37c6bb61fb9d service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.446939 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.447593 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.447874 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.448153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] PATH_INFO: `/v3/projects/f744682003e04004a75ffe2eebbf5c7d/users/a81041748a5b45d7be2c8cce68b34866/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.455795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1338/2672] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:11.465383 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f744682003e04004a75ffe2eebbf5c7d, user_id=a81041748a5b45d7be2c8cce68b34866, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.468623 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.485174 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1335/2673] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:11 2022] PUT /identity/v3/projects/f744682003e04004a75ffe2eebbf5c7d/users/a81041748a5b45d7be2c8cce68b34866/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:11.495559 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e8ab-62e4-40c5-98a3-24a91a655462 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.495998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e8ab-62e4-40c5-98a3-24a91a655462 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.496360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098e8ab-62e4-40c5-98a3-24a91a655462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.526366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-4098e8ab-62e4-40c5-98a3-24a91a655462 None None] MFA Rules not processed for user `a81041748a5b45d7be2c8cce68b34866`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:11.527853 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-4098e8ab-62e4-40c5-98a3-24a91a655462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:11.598016 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1339/2674] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:11.611413 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.613169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:11.674612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ea77b-2319-42c1-a0d8-27c17cbff817 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.678570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433826d7-9b13-420e-9aaf-90d6631f5362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.679268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433826d7-9b13-420e-9aaf-90d6631f5362 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.679617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433826d7-9b13-420e-9aaf-90d6631f5362 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.679963 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433826d7-9b13-420e-9aaf-90d6631f5362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.692125 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433826d7-9b13-420e-9aaf-90d6631f5362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.693682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433826d7-9b13-420e-9aaf-90d6631f5362 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.704535 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1336/2675] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:11.727347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e8ab-62e4-40c5-98a3-24a91a655462 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:11.768917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:11.891897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098e8ab-62e4-40c5-98a3-24a91a655462 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:11.903699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:11.904545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:11.905115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:11.906381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] PATH_INFO: `/v3/users/a81041748a5b45d7be2c8cce68b34866` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:11.907782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81041748a5b45d7be2c8cce68b34866)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:11.911230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:11.983642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81041748a5b45d7be2c8cce68b34866'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:11.984664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81041748a5b45d7be2c8cce68b34866'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.013466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239c4a-5fd4-4768-a3ed-9c15ad7c88e1 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.013975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239c4a-5fd4-4768-a3ed-9c15ad7c88e1 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.014251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239c4a-5fd4-4768-a3ed-9c15ad7c88e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.021127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81041748a5b45d7be2c8cce68b34866'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.023669 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81041748a5b45d7be2c8cce68b34866'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.052550 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81041748a5b45d7be2c8cce68b34866'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.055114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-57239c4a-5fd4-4768-a3ed-9c15ad7c88e1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:12.057706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-57239c4a-5fd4-4768-a3ed-9c15ad7c88e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:12.077654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1337/2676] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:12.087496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1340/2677] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:11 2022] DELETE /identity/v3/users/a81041748a5b45d7be2c8cce68b34866 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:12.089589 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.089884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.090161 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.102018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:12.103911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:12.122160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:12.123456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:12.219478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1dd4-ae28-45f4-9a83-51fb880c83f8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:12.225485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1338/2678] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:12.228705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:12.228705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.228705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.228705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.235025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:12.237168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:12.242275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:12.244424 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:12.256328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1341/2679] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:12.280246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:12.313401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2690f58-7efb-4b83-832e-20a1212e65ad None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:12.317556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7709b3-de15-49c1-b39d-deb44dc617ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:12.318235 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7709b3-de15-49c1-b39d-deb44dc617ff service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.318509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7709b3-de15-49c1-b39d-deb44dc617ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.318864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7709b3-de15-49c1-b39d-deb44dc617ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.331105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7709b3-de15-49c1-b39d-deb44dc617ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:12.333254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7709b3-de15-49c1-b39d-deb44dc617ff service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:12.345446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1339/2680] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:02:12.655190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:12.657727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:12.687268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690aa537-ed82-42a2-8dad-46b29179fe31 service nova] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:12.691970 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:12.692648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.692927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.693196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] PATH_INFO: `/v3/projects/f744682003e04004a75ffe2eebbf5c7d` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.694505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f744682003e04004a75ffe2eebbf5c7d)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:12.696452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:12.737295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:12.751508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f744682003e04004a75ffe2eebbf5c7d', 'request_id': 'req-455ba926-c60b-46c7-9607-720e6223c1b7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.757164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f744682003e04004a75ffe2eebbf5c7d', 'request_id': 'req-455ba926-c60b-46c7-9607-720e6223c1b7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.764080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f744682003e04004a75ffe2eebbf5c7d', 'request_id': 'req-455ba926-c60b-46c7-9607-720e6223c1b7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.777393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] The token cache is being invalidate because project f744682003e04004a75ffe2eebbf5c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:12.777708 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.778375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-455ba926-c60b-46c7-9607-720e6223c1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:12.779897 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1342/2681] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:12 2022] DELETE /identity/v3/projects/f744682003e04004a75ffe2eebbf5c7d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:12.784897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc6bc6-964f-4b20-8331-f568dab1ef82 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.785187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc6bc6-964f-4b20-8331-f568dab1ef82 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.785466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc6bc6-964f-4b20-8331-f568dab1ef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.805513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-fdfc6bc6-964f-4b20-8331-f568dab1ef82 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:12.806736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fdfc6bc6-964f-4b20-8331-f568dab1ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:12.868849 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1340/2682] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:12.877307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6d3e7-21fd-4e5d-a0d2-46713d9628b1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.877680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6d3e7-21fd-4e5d-a0d2-46713d9628b1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.878018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6d3e7-21fd-4e5d-a0d2-46713d9628b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.899987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ace6d3e7-21fd-4e5d-a0d2-46713d9628b1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:12.901431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ace6d3e7-21fd-4e5d-a0d2-46713d9628b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:12.910509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1343/2683] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:12.915200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc6bc6-964f-4b20-8331-f568dab1ef82 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:12.927039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc6bc6-964f-4b20-8331-f568dab1ef82 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:12.931711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:12.932323 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.932697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.933111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.933765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:12.934732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:12.937122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:12.949962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1341/2684] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:02:12.954273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6d3e7-21fd-4e5d-a0d2-46713d9628b1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:12.964450 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6d3e7-21fd-4e5d-a0d2-46713d9628b1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:12.969959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:12.970575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:12.970731 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:12.971022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:12.971643 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:12.973624 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:13.003864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1344/2685] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:12 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:13.007936 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:13.018986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cc799-bce6-4650-99ee-2ac4be9fe9db admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:13.080784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:13.081473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:13.081763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:13.082041 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:13.082683 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:13.084603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:13.109444 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1342/2686] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:13 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:13.113471 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:13.126919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70f1fb-a366-4bde-9c49-a2f6eea1c5f1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:13.131914 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:13.132558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:13.132860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:13.133107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:13.133809 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:13.135419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:13.147791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1345/2687] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:13.151974 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:13.164252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c950c5-0758-4de9-b8ba-03db6bdea216 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:13.171843 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29334b23-a7fd-44dc-bc67-854809eecd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:13.172744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334b23-a7fd-44dc-bc67-854809eecd3f admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:13.173024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334b23-a7fd-44dc-bc67-854809eecd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:13.173545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334b23-a7fd-44dc-bc67-854809eecd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:13.174236 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334b23-a7fd-44dc-bc67-854809eecd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:13.175829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29334b23-a7fd-44dc-bc67-854809eecd3f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:13.192435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1343/2688] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:02:13.194468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:13.205035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333c71-c6ba-4d04-8dd1-ea61c1db84b8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:13.209956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:13.210630 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:13.210917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:13.211291 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] PATH_INFO: `/v3/projects/ea1a7b725ab24babbde5ef74f4310fa9/users/768d46d63d95487f8c0ab74b58586b6f/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:13.228685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1a7b725ab24babbde5ef74f4310fa9, user_id=768d46d63d95487f8c0ab74b58586b6f, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:13.231602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:13.245844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1346/2689] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:13 2022] PUT /identity/v3/projects/ea1a7b725ab24babbde5ef74f4310fa9/users/768d46d63d95487f8c0ab74b58586b6f/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:13.312747 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d1cd-a6c5-478f-98b9-d3e809c0984f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:13.313035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d1cd-a6c5-478f-98b9-d3e809c0984f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:13.313313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14d1cd-a6c5-478f-98b9-d3e809c0984f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:13.341680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-9f14d1cd-a6c5-478f-98b9-d3e809c0984f None None] MFA Rules not processed for user `768d46d63d95487f8c0ab74b58586b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:13.343408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9f14d1cd-a6c5-478f-98b9-d3e809c0984f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:13.371120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:13.410350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1344/2690] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:13.421322 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:13.423018 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:13.482958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57926fb0-ed0a-4c59-af93-d7d07bcc625d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:13.486692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:13.487309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:13.487590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:13.487863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:13.496972 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:13.498442 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:13.508378 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1347/2691] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:15.236219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5c0a-08fc-4dde-9f92-0d714fc104ab None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:15.236717 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5c0a-08fc-4dde-9f92-0d714fc104ab None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:15.236831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5c0a-08fc-4dde-9f92-0d714fc104ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:15.259943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-36bb5c0a-08fc-4dde-9f92-0d714fc104ab None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:15.261280 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-36bb5c0a-08fc-4dde-9f92-0d714fc104ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:15.336403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1345/2692] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:15.358748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:15.360443 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:15.428488 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:15.451387 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8857dc-d03b-4c23-b29d-4872d5d519fa service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:15.458739 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e08ee-8d58-4733-a45d-956601ca1aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:15.459314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e08ee-8d58-4733-a45d-956601ca1aed service nova] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:15.459746 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e08ee-8d58-4733-a45d-956601ca1aed service nova] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:15.460328 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e08ee-8d58-4733-a45d-956601ca1aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:15.471075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e08ee-8d58-4733-a45d-956601ca1aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:15.473001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e08ee-8d58-4733-a45d-956601ca1aed service nova] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:15.499796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1348/2693] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:16.667779 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5c0a-08fc-4dde-9f92-0d714fc104ab None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:16.677327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5c0a-08fc-4dde-9f92-0d714fc104ab None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:16.681778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:16.682396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:16.682674 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:16.682946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] PATH_INFO: `/v3/users/768d46d63d95487f8c0ab74b58586b6f` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:16.684060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768d46d63d95487f8c0ab74b58586b6f)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:16.686000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:16.736231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768d46d63d95487f8c0ab74b58586b6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:16.736916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768d46d63d95487f8c0ab74b58586b6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:16.737522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768d46d63d95487f8c0ab74b58586b6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:16.744267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768d46d63d95487f8c0ab74b58586b6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:16.751868 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768d46d63d95487f8c0ab74b58586b6f'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:16.770725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1346/2694] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:16 2022] DELETE /identity/v3/users/768d46d63d95487f8c0ab74b58586b6f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:16.775085 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:16.775533 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:16.775619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:16.794373 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:16.795608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:16.856917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1349/2695] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:02:16.866673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:16.868179 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:16.913065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:16.928138 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a1ffd-6fbb-4f26-8eb9-6a8b9a9dea76 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:16.931719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dad61-1ef9-4946-bc4d-382a7d74c8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:16.932327 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dad61-1ef9-4946-bc4d-382a7d74c8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:16.932644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dad61-1ef9-4946-bc4d-382a7d74c8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:16.932916 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dad61-1ef9-4946-bc4d-382a7d74c8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:16.942318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dad61-1ef9-4946-bc4d-382a7d74c8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:16.943767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dad61-1ef9-4946-bc4d-382a7d74c8f0 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:16.953774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1347/2696] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:17.220261 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.221830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:17.235384 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e05be5d-e0a7-4278-979c-20be091328f1 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.240033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.240705 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.240985 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.241265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] PATH_INFO: `/v3/projects/ea1a7b725ab24babbde5ef74f4310fa9` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.242388 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1a7b725ab24babbde5ef74f4310fa9)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.244334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.295932 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1a7b725ab24babbde5ef74f4310fa9', 'request_id': 'req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:17.301649 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1a7b725ab24babbde5ef74f4310fa9', 'request_id': 'req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:17.307877 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1a7b725ab24babbde5ef74f4310fa9', 'request_id': 'req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:17.320748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] The token cache is being invalidate because project ea1a7b725ab24babbde5ef74f4310fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:17.321032 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:17.321795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-faa2c255-f3fd-4f2b-a854-df7e3a4899cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:17.323372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1350/2697] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:17 2022] DELETE /identity/v3/projects/ea1a7b725ab24babbde5ef74f4310fa9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:17.328201 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06604c8-61a4-47ce-8922-cdfaa6895e6f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.328521 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06604c8-61a4-47ce-8922-cdfaa6895e6f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.328797 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06604c8-61a4-47ce-8922-cdfaa6895e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.347621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-a06604c8-61a4-47ce-8922-cdfaa6895e6f None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:17.348845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-a06604c8-61a4-47ce-8922-cdfaa6895e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:17.405627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1348/2698] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:17.413084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668ec5-f5b1-457c-a95f-5bca39b9c081 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.413484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668ec5-f5b1-457c-a95f-5bca39b9c081 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.413770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668ec5-f5b1-457c-a95f-5bca39b9c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.433698 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-78668ec5-f5b1-457c-a95f-5bca39b9c081 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:17.434901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-78668ec5-f5b1-457c-a95f-5bca39b9c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:17.443400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1351/2699] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:17.447441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06604c8-61a4-47ce-8922-cdfaa6895e6f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.456877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06604c8-61a4-47ce-8922-cdfaa6895e6f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.461496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.462082 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.462358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.462625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.463256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:17.463550 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.465159 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.476912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1349/2700] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:02:17.481082 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668ec5-f5b1-457c-a95f-5bca39b9c081 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.490952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668ec5-f5b1-457c-a95f-5bca39b9c081 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.495717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.496404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.496689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.496960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.497595 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.499611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.528001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1352/2701] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:17 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:17.532841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.542785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04ad64-23b1-4a1e-9914-ac4ad3116c38 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.598456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.599066 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.599343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.599615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.600548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.602439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.623942 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1350/2702] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:17 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:17.628109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.639584 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213e12-c5df-4020-a75b-dab2bdc6e0f7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.644287 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.644918 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.645197 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.645470 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.646107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.647704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.657876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1353/2703] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:17.661635 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.672196 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7362b-ffdd-48d4-a225-2158bb305b6e admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.676885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74262a18-1740-48fe-acd2-95aef7e83a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.677478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74262a18-1740-48fe-acd2-95aef7e83a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.677762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74262a18-1740-48fe-acd2-95aef7e83a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.678040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74262a18-1740-48fe-acd2-95aef7e83a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.678682 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74262a18-1740-48fe-acd2-95aef7e83a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.680252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74262a18-1740-48fe-acd2-95aef7e83a68 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.690679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1351/2704] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:17.694587 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.704563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b824f7-7e7b-4628-9f72-6b0ef6ed0ca6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.709109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.709750 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.710034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.710310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] PATH_INFO: `/v3/projects/6bafc329d6224dd1b97592738255eb6c/users/accd4843ef114282bd66d095443f5395/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.725518 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bafc329d6224dd1b97592738255eb6c, user_id=accd4843ef114282bd66d095443f5395, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.728161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.741172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1354/2705] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:17 2022] PUT /identity/v3/projects/6bafc329d6224dd1b97592738255eb6c/users/accd4843ef114282bd66d095443f5395/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:17.752997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19ca7b-0900-4832-a4bc-945c1167e32f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.753415 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19ca7b-0900-4832-a4bc-945c1167e32f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.753755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19ca7b-0900-4832-a4bc-945c1167e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.781906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7b19ca7b-0900-4832-a4bc-945c1167e32f None None] MFA Rules not processed for user `accd4843ef114282bd66d095443f5395`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:17.783122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7b19ca7b-0900-4832-a4bc-945c1167e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:17.821529 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:17.848663 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1352/2706] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:17.860080 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:17.861913 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:17.868428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:17.921509 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bae744-002c-4bd6-918f-623b821a259a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:17.925340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35414b3e-d5b5-4d4d-8cec-73f9da40be42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:17.925951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414b3e-d5b5-4d4d-8cec-73f9da40be42 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:17.926260 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414b3e-d5b5-4d4d-8cec-73f9da40be42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:17.926537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35414b3e-d5b5-4d4d-8cec-73f9da40be42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:17.935195 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35414b3e-d5b5-4d4d-8cec-73f9da40be42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:17.936597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35414b3e-d5b5-4d4d-8cec-73f9da40be42 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:17.946232 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1355/2707] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:19.308457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:19.309515 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:19.309890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:19.333991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] MFA Rules not processed for user `accd4843ef114282bd66d095443f5395`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:19.335332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:19.343468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1353/2708] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:20.463434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679c61-ed16-4a2b-b01d-ed0e03246bc1 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:20.463434 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679c61-ed16-4a2b-b01d-ed0e03246bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:20.464037 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679c61-ed16-4a2b-b01d-ed0e03246bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:20.487074 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-52679c61-ed16-4a2b-b01d-ed0e03246bc1 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:20.488714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-52679c61-ed16-4a2b-b01d-ed0e03246bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:20.557654 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1356/2709] 10.222.0.71 () {58 vars in 1016 bytes} [Wed Aug 24 09:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:20.579206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:20.581499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:20.657482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69c444-36da-4421-8e97-449a9eae5f76 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:20.663155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:20.663768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:20.664047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:20.664322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:20.672765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:20.674334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:20.683762 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1354/2710] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:30.549793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=51 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:30.679705 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=47 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:37.345239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f50fa-bfb2-4d4e-b35f-7ac1a746d3e6 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:37.345756 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f50fa-bfb2-4d4e-b35f-7ac1a746d3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:37.346461 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f50fa-bfb2-4d4e-b35f-7ac1a746d3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:37.369593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-ae3f50fa-bfb2-4d4e-b35f-7ac1a746d3e6 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:37.371682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-ae3f50fa-bfb2-4d4e-b35f-7ac1a746d3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:37.441682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1357/2711] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 09:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:37.489367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:37.490885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:37.558884 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052944e-6aca-4642-8a08-6df4a72a63ac service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:37.563752 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:37.564352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:37.564659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:37.564928 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:37.572838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:37.574398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:37.583398 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1355/2712] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:02:38.084846 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfb33-41cd-4a35-b35d-a3f7fc6a7137 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:38.085141 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfb33-41cd-4a35-b35d-a3f7fc6a7137 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:38.085418 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfb33-41cd-4a35-b35d-a3f7fc6a7137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:38.104597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-f5ddfb33-41cd-4a35-b35d-a3f7fc6a7137 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:38.105796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f5ddfb33-41cd-4a35-b35d-a3f7fc6a7137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:38.113456 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1358/2713] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 24 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:38.126080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:38.136412 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8c20b-e10f-47f9-a63c-bc982ad440f4 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:38.141332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:38.141926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:38.142206 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:38.142482 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:38.150182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:38.151755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:38.159503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1356/2714] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:02:38.378711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2dee-abab-45ca-b0f7-6d59824a6488 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:38.379185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2dee-abab-45ca-b0f7-6d59824a6488 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:38.379185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e2dee-abab-45ca-b0f7-6d59824a6488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:38.397552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-219e2dee-abab-45ca-b0f7-6d59824a6488 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:38.398728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-219e2dee-abab-45ca-b0f7-6d59824a6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:38.405691 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1359/2715] 10.222.0.42 () {58 vars in 1009 bytes} [Wed Aug 24 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:38.417086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:38.428570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe6cd4-5c52-44ec-8df5-938d20499715 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:38.433738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:38.434337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:38.434622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:38.435089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:38.443918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:38.445530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:38.453662 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1357/2716] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:02:38.803385 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ab1e-0074-49ad-a320-86222bab2ca2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:38.803673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ab1e-0074-49ad-a320-86222bab2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:38.803943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552ab1e-0074-49ad-a320-86222bab2ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:38.822358 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-3552ab1e-0074-49ad-a320-86222bab2ca2 None None] MFA Rules not processed for user `5e4eb89916664004afa763f612d2937b`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:38.823534 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-3552ab1e-0074-49ad-a320-86222bab2ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:38.831047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1360/2717] 10.222.0.42 () {58 vars in 967 bytes} [Wed Aug 24 09:02:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:38.843040 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:38.854542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716cc05-4d81-4d01-8d56-282e8dda76e5 service swift] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:38.859586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758899f-0574-4d81-86ea-04d82586b0a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bb73a7c308340f48fc0106e96de3f7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:38.860185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758899f-0574-4d81-86ea-04d82586b0a0 service swift] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:38.860503 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758899f-0574-4d81-86ea-04d82586b0a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:38.860784 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758899f-0574-4d81-86ea-04d82586b0a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:38.869000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758899f-0574-4d81-86ea-04d82586b0a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:38.870622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758899f-0574-4d81-86ea-04d82586b0a0 service swift] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:38.878649 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1358/2718] 10.222.0.42 () {60 vars in 1384 bytes} [Wed Aug 24 09:02:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 09:02:40.978145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552ab1e-0074-49ad-a320-86222bab2ca2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:40.989201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552ab1e-0074-49ad-a320-86222bab2ca2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:40.993987 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:40.994608 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:40.994889 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:40.995161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] PATH_INFO: `/v3/users/accd4843ef114282bd66d095443f5395` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:40.996304 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=accd4843ef114282bd66d095443f5395)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:40.998941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:41.045690 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accd4843ef114282bd66d095443f5395'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.046416 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accd4843ef114282bd66d095443f5395'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.054044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accd4843ef114282bd66d095443f5395'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.054752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accd4843ef114282bd66d095443f5395'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.063301 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accd4843ef114282bd66d095443f5395'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.082780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1361/2719] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:40 2022] DELETE /identity/v3/users/accd4843ef114282bd66d095443f5395 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:41.087336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:41.087909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:41.088024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:41.107540 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:41.109354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:41.171484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1359/2720] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:41.183532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:41.185112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:41.254560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17718436-ed12-4652-93ff-9cdcda152292 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:41.255227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:41.255840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:41.256123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:41.256422 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:41.265747 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:41.267228 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:41.272288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:41.277510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1362/2721] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:41.448462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:41.449941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:41.468414 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66726d-80aa-4a55-9fa9-14d4062f289d None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:41.473225 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:41.474155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:41.474616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:41.475085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] PATH_INFO: `/v3/projects/6bafc329d6224dd1b97592738255eb6c` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:41.476218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bafc329d6224dd1b97592738255eb6c)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:41.478556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:41.524121 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:41.527545 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bafc329d6224dd1b97592738255eb6c', 'request_id': 'req-f1728b4a-b100-4270-9da6-65678b720c5b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.534237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bafc329d6224dd1b97592738255eb6c', 'request_id': 'req-f1728b4a-b100-4270-9da6-65678b720c5b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.541528 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bafc329d6224dd1b97592738255eb6c', 'request_id': 'req-f1728b4a-b100-4270-9da6-65678b720c5b'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.553390 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] The token cache is being invalidate because project 6bafc329d6224dd1b97592738255eb6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:41.553678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.554311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:41.555785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1360/2722] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:41 2022] DELETE /identity/v3/projects/6bafc329d6224dd1b97592738255eb6c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:49.623873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:49.625374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:49.678266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:49.679714 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:49.710802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9debd84-33c1-4029-b06b-f65101648c05 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:49.745927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1728b4a-b100-4270-9da6-65678b720c5b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:49.750524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:49.751156 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:49.751439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:49.751716 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] PATH_INFO: `/v3/users/01b42bfd23334d4a8c477af08a178607` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:49.752878 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b42bfd23334d4a8c477af08a178607)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:49.754792 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:49.773699 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:49.774313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:49.774597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:49.774866 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:49.776780 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:49.789480 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:49.790996 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:49.801994 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1363/2723] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:49.803801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b42bfd23334d4a8c477af08a178607'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:49.804509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b42bfd23334d4a8c477af08a178607'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:49.805120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b42bfd23334d4a8c477af08a178607'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:49.813816 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b42bfd23334d4a8c477af08a178607'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:49.821706 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4df8aed-fa79-4441-ba72-0520ba8eb6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b42bfd23334d4a8c477af08a178607'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:49.842097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1361/2724] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:49 2022] DELETE /identity/v3/users/01b42bfd23334d4a8c477af08a178607 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:50.011597 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.025396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212631-4ded-4511-9e48-17e5067b05eb service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.090706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.091266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.091552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.091852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] PATH_INFO: `/v3/projects/e2c551c660cc4a479fc3cb5e545aee36` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.093010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c551c660cc4a479fc3cb5e545aee36)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.095041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.132244 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:50.143086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c551c660cc4a479fc3cb5e545aee36', 'request_id': 'req-1697f2ca-3a5c-4a28-a442-884c07442c01'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:50.148588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c551c660cc4a479fc3cb5e545aee36', 'request_id': 'req-1697f2ca-3a5c-4a28-a442-884c07442c01'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:50.154549 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c551c660cc4a479fc3cb5e545aee36', 'request_id': 'req-1697f2ca-3a5c-4a28-a442-884c07442c01'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:50.166924 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] The token cache is being invalidate because project e2c551c660cc4a479fc3cb5e545aee36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:50.167316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:50.168090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-1697f2ca-3a5c-4a28-a442-884c07442c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:50.170207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1364/2725] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:50 2022] DELETE /identity/v3/projects/e2c551c660cc4a479fc3cb5e545aee36 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:02:50.175333 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63dd04-5d8f-4d6d-b33a-a82b9b3e91e6 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.175624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63dd04-5d8f-4d6d-b33a-a82b9b3e91e6 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.175909 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63dd04-5d8f-4d6d-b33a-a82b9b3e91e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.195630 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-8e63dd04-5d8f-4d6d-b33a-a82b9b3e91e6 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:50.196866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-8e63dd04-5d8f-4d6d-b33a-a82b9b3e91e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:50.243120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:50.257269 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1362/2726] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:50.264937 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c917c3-c2a2-4f42-a19c-381ec10082b9 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.265260 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c917c3-c2a2-4f42-a19c-381ec10082b9 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.265540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c917c3-c2a2-4f42-a19c-381ec10082b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.284976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d9c917c3-c2a2-4f42-a19c-381ec10082b9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:50.286216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d9c917c3-c2a2-4f42-a19c-381ec10082b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:50.294117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1365/2727] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:50.298790 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63dd04-5d8f-4d6d-b33a-a82b9b3e91e6 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.308198 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63dd04-5d8f-4d6d-b33a-a82b9b3e91e6 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.313407 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.314009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.314290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.314560 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.315199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:50.315506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.317124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.328249 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1363/2728] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:02:50.332311 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c917c3-c2a2-4f42-a19c-381ec10082b9 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.341614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c917c3-c2a2-4f42-a19c-381ec10082b9 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.346143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.346734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.347011 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.347284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.347910 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.350112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.377642 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1366/2729] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:50 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:50.381658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.391329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a080e-0991-4b0e-b2e7-98b7eb40aa04 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.445778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.446375 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.446651 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.446919 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.447541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.449459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.470289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1364/2730] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:50 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:50.475732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.486494 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae52ee4-a77d-448d-bd58-53038361fad8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.491161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.491755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.492036 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.492309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.493004 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.494596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.504314 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1367/2731] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:50.507935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.517711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7cd27-81d5-40f7-96a3-3e4ab4396482 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.522237 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f33b8e-7a1f-4e96-bf8f-de5720c6293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.522822 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33b8e-7a1f-4e96-bf8f-de5720c6293e admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.523104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33b8e-7a1f-4e96-bf8f-de5720c6293e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.523381 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f33b8e-7a1f-4e96-bf8f-de5720c6293e admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.524024 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f33b8e-7a1f-4e96-bf8f-de5720c6293e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.525650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f33b8e-7a1f-4e96-bf8f-de5720c6293e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.536349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1365/2732] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:50.540178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.550530 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca677-0462-47e7-92a6-2b4db5620355 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.555158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.555802 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.556084 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.556359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] PATH_INFO: `/v3/projects/1fa30a62a71b4c3a8df7b8c1591be5fe/users/a8d41fceed814a1a952d173879f9895d/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.570829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fa30a62a71b4c3a8df7b8c1591be5fe, user_id=a8d41fceed814a1a952d173879f9895d, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.573602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.588538 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1368/2733] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:50 2022] PUT /identity/v3/projects/1fa30a62a71b4c3a8df7b8c1591be5fe/users/a8d41fceed814a1a952d173879f9895d/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:50.599506 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4965cb7-4f3e-4a05-b2c0-d8add0ab4380 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.599736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4965cb7-4f3e-4a05-b2c0-d8add0ab4380 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.600037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4965cb7-4f3e-4a05-b2c0-d8add0ab4380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.626998 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e4965cb7-4f3e-4a05-b2c0-d8add0ab4380 None None] MFA Rules not processed for user `a8d41fceed814a1a952d173879f9895d`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:50.628197 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e4965cb7-4f3e-4a05-b2c0-d8add0ab4380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:50.689760 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1366/2734] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:50.701687 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:50.703447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:50.759426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba8f0d-a841-44f4-aa24-dd170a8d12db admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:50.763000 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7283c-bba7-4f31-a58e-8133855e60b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:50.764143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7283c-bba7-4f31-a58e-8133855e60b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:50.764445 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7283c-bba7-4f31-a58e-8133855e60b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:50.764745 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7283c-bba7-4f31-a58e-8133855e60b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:50.772817 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7283c-bba7-4f31-a58e-8133855e60b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:50.774243 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7283c-bba7-4f31-a58e-8133855e60b4 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:50.782784 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1369/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:55.753105 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4965cb7-4f3e-4a05-b2c0-d8add0ab4380 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:55.802205 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:55.817736 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4965cb7-4f3e-4a05-b2c0-d8add0ab4380 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:55.822177 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:55.822834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:55.823114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:55.823385 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] PATH_INFO: `/v3/users/a8d41fceed814a1a952d173879f9895d` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:55.824532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d41fceed814a1a952d173879f9895d)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:55.826431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:55.871968 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d41fceed814a1a952d173879f9895d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:55.873102 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d41fceed814a1a952d173879f9895d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:55.873721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d41fceed814a1a952d173879f9895d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:55.880530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d41fceed814a1a952d173879f9895d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:55.887603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d41fceed814a1a952d173879f9895d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:55.905230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1367/2736] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:02:55 2022] DELETE /identity/v3/users/a8d41fceed814a1a952d173879f9895d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:55.909637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:55.910087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:55.910196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:55.928634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:55.930884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:55.988768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1370/2737] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:55.998898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.000314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:56.056425 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3127ff-1d87-47f1-a42a-e5cc5e8c0d5c admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.060700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e4fd-750b-4e4d-8fbe-bb58541e9469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.061309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e4fd-750b-4e4d-8fbe-bb58541e9469 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.061590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e4fd-750b-4e4d-8fbe-bb58541e9469 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.061864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e4fd-750b-4e4d-8fbe-bb58541e9469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.071261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e4fd-750b-4e4d-8fbe-bb58541e9469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.072733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e4fd-750b-4e4d-8fbe-bb58541e9469 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.082693 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1368/2738] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:02:56.352094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.353660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:56.361547 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:56.367188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d102d-6f1c-485d-b18c-c58fc826d78a None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.374507 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.375625 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.376227 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.376977 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] PATH_INFO: `/v3/projects/1fa30a62a71b4c3a8df7b8c1591be5fe` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.378903 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fa30a62a71b4c3a8df7b8c1591be5fe)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.381237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.427519 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fa30a62a71b4c3a8df7b8c1591be5fe', 'request_id': 'req-bf749638-c6e6-44ff-b7fc-a977e7fb151d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:56.433346 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fa30a62a71b4c3a8df7b8c1591be5fe', 'request_id': 'req-bf749638-c6e6-44ff-b7fc-a977e7fb151d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:56.440062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fa30a62a71b4c3a8df7b8c1591be5fe', 'request_id': 'req-bf749638-c6e6-44ff-b7fc-a977e7fb151d'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:56.452351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] The token cache is being invalidate because project 1fa30a62a71b4c3a8df7b8c1591be5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:02:56.452682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:56.453316 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bf749638-c6e6-44ff-b7fc-a977e7fb151d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:02:56.454795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1371/2739] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:02:56 2022] DELETE /identity/v3/projects/1fa30a62a71b4c3a8df7b8c1591be5fe => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:56.459673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23008c-1ef2-4cbd-acf7-864147fc1b91 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.459962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23008c-1ef2-4cbd-acf7-864147fc1b91 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.460238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23008c-1ef2-4cbd-acf7-864147fc1b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.480130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6a23008c-1ef2-4cbd-acf7-864147fc1b91 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:56.481369 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6a23008c-1ef2-4cbd-acf7-864147fc1b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:56.538742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1369/2740] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:56.547386 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ca08-ff24-40d0-a542-1eb08b51c35d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.547671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ca08-ff24-40d0-a542-1eb08b51c35d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.547951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ca08-ff24-40d0-a542-1eb08b51c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.567902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-c982ca08-ff24-40d0-a542-1eb08b51c35d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:56.569156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-c982ca08-ff24-40d0-a542-1eb08b51c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:56.577095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1372/2741] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:56.581962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23008c-1ef2-4cbd-acf7-864147fc1b91 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.591711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23008c-1ef2-4cbd-acf7-864147fc1b91 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.596332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.596960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.597242 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.597517 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.598164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:02:56.598738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.600325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.607453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:02:56.613318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1370/2742] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:02:56.617682 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982ca08-ff24-40d0-a542-1eb08b51c35d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.627315 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982ca08-ff24-40d0-a542-1eb08b51c35d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.631954 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.632590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.632870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.633144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.633773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.635658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.663431 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1373/2743] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:02:56 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:56.667247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.677005 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd633e-04d8-42e9-8fdd-838df80bcbd0 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.731666 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.732194 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.732502 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.732773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.733457 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.735270 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.755887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1371/2744] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:02:56 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:02:56.760231 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.771429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10597f3-965b-44aa-ac28-7db2156064ce admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.775971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.776596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.776899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.777174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.777839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.779468 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.789245 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1374/2745] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:56.793054 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.802853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e8806-a3ca-45b8-9787-76d04c7fa185 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.807416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929157f-4182-4315-b3fd-50da27d9ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.808002 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929157f-4182-4315-b3fd-50da27d9ab32 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.808282 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929157f-4182-4315-b3fd-50da27d9ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.808594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929157f-4182-4315-b3fd-50da27d9ab32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.809231 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929157f-4182-4315-b3fd-50da27d9ab32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.811283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929157f-4182-4315-b3fd-50da27d9ab32 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.821522 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1372/2746] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:02:56.825408 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.835988 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e08135-4f4b-4169-8c3f-601c18ed477a admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:56.840734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:56.841396 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.841673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.841946 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] PATH_INFO: `/v3/projects/3295460cf4a144958ef65b7c9808c79b/users/20e6815fb4a74cec90300abf6a355a07/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.856478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3295460cf4a144958ef65b7c9808c79b, user_id=20e6815fb4a74cec90300abf6a355a07, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:56.859577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:56.872078 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1375/2747] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:02:56 2022] PUT /identity/v3/projects/3295460cf4a144958ef65b7c9808c79b/users/20e6815fb4a74cec90300abf6a355a07/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:02:56.877720 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9228-75d8-4a86-ba48-bd8ede5da4fc None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:56.878062 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9228-75d8-4a86-ba48-bd8ede5da4fc None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:56.878345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9228-75d8-4a86-ba48-bd8ede5da4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:56.897032 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-03cd9228-75d8-4a86-ba48-bd8ede5da4fc None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:02:56.898219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-03cd9228-75d8-4a86-ba48-bd8ede5da4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:56.954815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1373/2748] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:02:56.964476 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:02:56.966215 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:02:57.023144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bd348-d9f4-4b28-b1c1-af568deebd53 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:02:57.026839 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:02:57.027463 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:02:57.027738 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:02:57.028007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:02:57.045132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:02:57.046867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:02:57.056185 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1376/2749] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:03:00.986277 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099083ba-dfd3-4f55-995f-a19089a0bdb2 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:00.986812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099083ba-dfd3-4f55-995f-a19089a0bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:00.986812 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099083ba-dfd3-4f55-995f-a19089a0bdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:01.014753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-099083ba-dfd3-4f55-995f-a19089a0bdb2 None None] MFA Rules not processed for user `20e6815fb4a74cec90300abf6a355a07`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:03:01.016008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-099083ba-dfd3-4f55-995f-a19089a0bdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:03:01.099178 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1374/2750] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:03:01.105447 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:01.116007 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ddab2-483b-4854-9d29-b4fcccbc24dd service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:01.128948 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:01.129578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:01.129863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:01.130139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:01.130783 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:01.132763 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:01.161294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1377/2751] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:03:01 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:03:01.165331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099083ba-dfd3-4f55-995f-a19089a0bdb2 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:01.178850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099083ba-dfd3-4f55-995f-a19089a0bdb2 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:01.182859 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:01.241890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:01.242513 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:01.242935 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:01.243217 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:01.243861 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:01.245879 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:01.274930 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1375/2752] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:03:01 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:03:01.276372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:01.285611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:01.297580 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252443da-fcba-4f35-9721-3052feb27fc4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:01.302377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:01.303015 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:01.303294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:01.303569 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:01.304230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:01.306088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:01.317884 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1378/2753] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 09:03:01.323525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:01.334318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307215ab-2ead-48db-9015-3e4d126d1d1d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:01.339047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:01.339725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:01.340011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:01.340290 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] PATH_INFO: `/v3/projects/bd503c52c4b24dae9a0ad09f30208a8e/users/91f530236e0c4e8d99c7d58707cc4224/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:01.358594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd503c52c4b24dae9a0ad09f30208a8e, user_id=91f530236e0c4e8d99c7d58707cc4224, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:01.361345 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:01.375578 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1376/2754] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:03:01 2022] PUT /identity/v3/projects/bd503c52c4b24dae9a0ad09f30208a8e/users/91f530236e0c4e8d99c7d58707cc4224/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:03:01.379788 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:01.391005 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3ea8b-33a9-454f-a7b0-c9412d9846f7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:01.449797 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c365a-e361-45f8-bf2b-1a3bee724782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:01.451054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c365a-e361-45f8-bf2b-1a3bee724782 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:01.451363 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c365a-e361-45f8-bf2b-1a3bee724782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:01.451656 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c365a-e361-45f8-bf2b-1a3bee724782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:01.452374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c365a-e361-45f8-bf2b-1a3bee724782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:01.454196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c365a-e361-45f8-bf2b-1a3bee724782 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:01.465142 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1379/2755] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:03:01.472176 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:01.483080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997098f9-de63-4d21-9927-a5442ef7d593 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:01.488033 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:01.488811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:01.489091 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:01.489360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] PATH_INFO: `/v3/projects/bd503c52c4b24dae9a0ad09f30208a8e/users/91f530236e0c4e8d99c7d58707cc4224/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:01.491293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd503c52c4b24dae9a0ad09f30208a8e, user_id=91f530236e0c4e8d99c7d58707cc4224, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:01.494126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:01.508625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1377/2756] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:03:01 2022] PUT /identity/v3/projects/bd503c52c4b24dae9a0ad09f30208a8e/users/91f530236e0c4e8d99c7d58707cc4224/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:03:05.739572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac256-644a-4845-8613-0f8ef9708b2d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:05.740035 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac256-644a-4845-8613-0f8ef9708b2d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:05.740133 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ac256-644a-4845-8613-0f8ef9708b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:05.772323 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-e89ac256-644a-4845-8613-0f8ef9708b2d None None] MFA Rules not processed for user `91f530236e0c4e8d99c7d58707cc4224`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:03:05.773589 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e89ac256-644a-4845-8613-0f8ef9708b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:03:05.848414 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1380/2757] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:03:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:03:05.865579 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:05.868059 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:03:05.981962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0825e2-6ebe-4d7b-9c70-65357bc7f516 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:05.987696 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:05.988431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:05.988782 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:05.989124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:06.058566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:06.062468 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:06.065026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:06.075902 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1378/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:03:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 09:03:07.071274 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:07.071800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:07.071899 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:07.091181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] MFA Rules not processed for user `20e6815fb4a74cec90300abf6a355a07`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:03:07.092426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:03:07.099594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1381/2759] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:03:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:03:16.070735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:17.085219 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=70 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:03:31.711401 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:03:31.712838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:03:31.795459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce44f-1d06-4138-825e-c9d6d1e6aed2 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:03:31.799172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccda767-3cde-4485-81da-8cf2b33d77e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:03:31.799761 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccda767-3cde-4485-81da-8cf2b33d77e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:03:31.800038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccda767-3cde-4485-81da-8cf2b33d77e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:03:31.800308 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccda767-3cde-4485-81da-8cf2b33d77e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:03:31.829114 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccda767-3cde-4485-81da-8cf2b33d77e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:03:31.830527 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccda767-3cde-4485-81da-8cf2b33d77e8 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:03:31.839906 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1379/2760] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:03:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:03:41.839367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=48 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:32.582057 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:04:32.583499 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:04:32.704727 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec0931-044e-4ded-9905-764657ec88ea None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:04:32.710088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:04:32.710734 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:04:32.711014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:04:32.711286 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:04:32.713154 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:04:32.725238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:04:32.726840 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:04:32.737115 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1382/2761] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:04:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:04:42.732905 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=53 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:04:51.785823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb112c-7d79-474f-b3bd-f864394c7c17 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:04:51.786392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb112c-7d79-474f-b3bd-f864394c7c17 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:04:51.786392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb112c-7d79-474f-b3bd-f864394c7c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:04:51.805134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b5cb112c-7d79-474f-b3bd-f864394c7c17 None None] MFA Rules not processed for user `a14d333bdc4d4a1d870ecafca4a926aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:04:51.806389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b5cb112c-7d79-474f-b3bd-f864394c7c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:04:51.862607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1380/2762] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:04:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:05:01.855530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=25 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:28.608070 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:05:28.628757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c567d8-1a80-49b4-9c57-d538ee7d8ab2 service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:05:28.632351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:05:28.632979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:05:28.633262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:05:28.633537 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:05:28.635265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:05:28.666782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:05:28.668213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:05:28.690092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1383/2763] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:05:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:05:29.869887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb112c-7d79-474f-b3bd-f864394c7c17 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:05:29.880092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb112c-7d79-474f-b3bd-f864394c7c17 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:05:29.883778 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:05:29.884403 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:05:29.884694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:05:29.884970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:05:29.886698 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:05:29.901090 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:05:29.902514 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:05:29.913435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1381/2764] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:05:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:05:38.687911 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=22 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:39.908537 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:41.956171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:05:41.965335 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb09b7-3b80-486e-b7c3-c3d6a5aa9347 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:05:41.969449 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:05:41.970099 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:05:41.970412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:05:41.970764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:05:41.972599 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:05:41.995695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:05:41.997271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:05:42.006234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1384/2765] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:05:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:05:42.103994 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:05:42.113130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ad791-86ae-4109-85f2-a70bc1672a23 service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:05:42.116724 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:05:42.117332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:05:42.117604 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:05:42.117882 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:05:42.119564 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:05:42.133199 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:05:42.134619 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:05:42.145358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1382/2766] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:05:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:05:52.002307 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=11 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:05:52.141155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:05.949395 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:05.950968 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:05.967280 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5e89a-a8fc-4ab0-a9df-446e7cf5e129 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:05.972927 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:05.973650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:05.974041 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:05.974438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:05.976284 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:05.992867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:05.994611 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:06.012602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1385/2767] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:06.013866 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:06.016297 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:06.131336 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f26175-3c70-4210-8540-0c459a68c05f service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:06.135925 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:06.136594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:06.136886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:06.137160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] PATH_INFO: `/v3/users/a14d333bdc4d4a1d870ecafca4a926aa` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:06.138467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14d333bdc4d4a1d870ecafca4a926aa)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:06.140823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:06.194847 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14d333bdc4d4a1d870ecafca4a926aa'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.195536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14d333bdc4d4a1d870ecafca4a926aa'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.196169 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14d333bdc4d4a1d870ecafca4a926aa'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.204053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14d333bdc4d4a1d870ecafca4a926aa'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.215753 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-f35f416f-36c0-4fda-827a-070159b4f90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14d333bdc4d4a1d870ecafca4a926aa'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.235081 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1383/2768] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:06 2022] DELETE /identity/v3/users/a14d333bdc4d4a1d870ecafca4a926aa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:06.407554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:06.418013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ec038-4742-4bd8-8a3d-09f38ad9d037 service placement] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:06.476352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:06.477013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:06.477294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:06.477566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] PATH_INFO: `/v3/projects/5d3e88979eca417a981aa360d97df660` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:06.478683 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3e88979eca417a981aa360d97df660)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:06.480633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:06.527535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3e88979eca417a981aa360d97df660', 'request_id': 'req-9262e1b4-dc32-4d4b-8379-28ac7aaed451'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.533136 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3e88979eca417a981aa360d97df660', 'request_id': 'req-9262e1b4-dc32-4d4b-8379-28ac7aaed451'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.539083 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3e88979eca417a981aa360d97df660', 'request_id': 'req-9262e1b4-dc32-4d4b-8379-28ac7aaed451'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.551505 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] The token cache is being invalidate because project 5d3e88979eca417a981aa360d97df660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:06.551796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.552472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-9262e1b4-dc32-4d4b-8379-28ac7aaed451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:06.554201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1386/2769] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:06 2022] DELETE /identity/v3/projects/5d3e88979eca417a981aa360d97df660 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:06.559029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4c9f-a963-4e36-8cfa-1cc70a87de2a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:06.559328 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4c9f-a963-4e36-8cfa-1cc70a87de2a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:06.559610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4c9f-a963-4e36-8cfa-1cc70a87de2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:06.618898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-f49a4c9f-a963-4e36-8cfa-1cc70a87de2a None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:06.620112 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-f49a4c9f-a963-4e36-8cfa-1cc70a87de2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:06.633133 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:06.679632 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1384/2770] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:06.688156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2499d-dff6-415a-9809-abf211b3d455 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:06.688486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2499d-dff6-415a-9809-abf211b3d455 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:06.688791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2499d-dff6-415a-9809-abf211b3d455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:06.832158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b1a2499d-dff6-415a-9809-abf211b3d455 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:06.833429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b1a2499d-dff6-415a-9809-abf211b3d455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:06.841631 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1387/2771] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:06.846432 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4c9f-a963-4e36-8cfa-1cc70a87de2a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:06.856376 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4c9f-a963-4e36-8cfa-1cc70a87de2a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:06.860946 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:06.861547 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:06.861850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:06.862153 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:06.862803 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:06:06.863141 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:06.864723 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:06.875871 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1385/2772] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:06:06.880189 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2499d-dff6-415a-9809-abf211b3d455 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:06.889791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2499d-dff6-415a-9809-abf211b3d455 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:06.894641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:06.895237 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:06.895513 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:06.895782 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:06.896428 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:06.898339 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:06.933515 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1388/2773] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:06 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:06:06.937687 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:06.947442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab562225-52be-498b-b4bc-4d5e21b2b3b3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.003213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.003823 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.004108 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.004408 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.005047 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.006954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.029074 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1386/2774] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:06 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:07.033770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.043956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6ac76-50fd-4e45-a06f-1cbe537a7d2f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.048635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.049230 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.049510 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.049786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.050457 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.052168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.063001 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1389/2775] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:07.066865 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.076673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1dd9c-70de-492a-ab63-bd8e397141e8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.081863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104984e9-b122-465f-8189-9d45272438e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.082396 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104984e9-b122-465f-8189-9d45272438e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.082681 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104984e9-b122-465f-8189-9d45272438e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.082954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104984e9-b122-465f-8189-9d45272438e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.083590 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104984e9-b122-465f-8189-9d45272438e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.085219 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104984e9-b122-465f-8189-9d45272438e4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.095670 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1387/2776] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:07.099860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.109807 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bde04-1fa9-430d-8160-af9487d66355 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.114350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.114986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.115267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.115543 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] PATH_INFO: `/v3/projects/298386093bf746a7b975a408d59dfd12/users/ec9b5d995e6f4844a207cb1710116782/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.130641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298386093bf746a7b975a408d59dfd12, user_id=ec9b5d995e6f4844a207cb1710116782, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.133272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.146606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1390/2777] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:07 2022] PUT /identity/v3/projects/298386093bf746a7b975a408d59dfd12/users/ec9b5d995e6f4844a207cb1710116782/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:07.157397 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64626e-46fe-4fb4-a311-ea8d9d78d04f None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.157686 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64626e-46fe-4fb4-a311-ea8d9d78d04f None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.157962 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64626e-46fe-4fb4-a311-ea8d9d78d04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.184924 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-3e64626e-46fe-4fb4-a311-ea8d9d78d04f None None] MFA Rules not processed for user `ec9b5d995e6f4844a207cb1710116782`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:07.186615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3e64626e-46fe-4fb4-a311-ea8d9d78d04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:07.248187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1388/2778] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:07.253200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.258908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:07.315374 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ffc0db-c131-4989-bf8c-edd2b6dc8314 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.319915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.320554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.320837 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.321109 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.321728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.323613 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.350529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1391/2779] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:07 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:07.354735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64626e-46fe-4fb4-a311-ea8d9d78d04f None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.366805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64626e-46fe-4fb4-a311-ea8d9d78d04f None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.378549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:07.431509 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.432131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.432445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.432721 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.433354 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.435254 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.457352 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1389/2780] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:07 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:07.461489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.472688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103efd-cdce-414c-84fc-b3b708442d6e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.477235 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.477835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.478122 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.478397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.479033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.480801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.490771 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1392/2781] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:07.495029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.504933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b0d2a-b2df-4d51-8bad-0d26090f0555 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.509500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.510149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.510431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.510709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] PATH_INFO: `/v3/projects/4d9aa255b67c4a91857f5b848811bc75/users/65dd9168fba54c92b529bf6efe48d7b2/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.525519 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9aa255b67c4a91857f5b848811bc75, user_id=65dd9168fba54c92b529bf6efe48d7b2, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.528137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.541783 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1390/2782] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:07 2022] PUT /identity/v3/projects/4d9aa255b67c4a91857f5b848811bc75/users/65dd9168fba54c92b529bf6efe48d7b2/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:07.545790 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.555714 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e827a6-a8b4-44cb-8b1e-83d5c8baa4d5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.612342 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39d8ac-00c2-4ecc-882f-7c6e810d6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.612923 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d8ac-00c2-4ecc-882f-7c6e810d6292 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.613206 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d8ac-00c2-4ecc-882f-7c6e810d6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.613482 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39d8ac-00c2-4ecc-882f-7c6e810d6292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.614123 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39d8ac-00c2-4ecc-882f-7c6e810d6292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.615719 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39d8ac-00c2-4ecc-882f-7c6e810d6292 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.625267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1393/2783] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:07.629441 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.639920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11cea-7328-4b69-941f-89f60a33e93a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.644416 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.645053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.645330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.645602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] PATH_INFO: `/v3/projects/4d9aa255b67c4a91857f5b848811bc75/users/65dd9168fba54c92b529bf6efe48d7b2/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.647486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9aa255b67c4a91857f5b848811bc75, user_id=65dd9168fba54c92b529bf6efe48d7b2, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.650089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.660777 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1391/2784] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:07 2022] PUT /identity/v3/projects/4d9aa255b67c4a91857f5b848811bc75/users/65dd9168fba54c92b529bf6efe48d7b2/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:07.672637 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6e19-c4d4-4e26-9073-e7b874266293 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.672933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6e19-c4d4-4e26-9073-e7b874266293 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.673216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6e19-c4d4-4e26-9073-e7b874266293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.699847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-65eb6e19-c4d4-4e26-9073-e7b874266293 None None] MFA Rules not processed for user `65dd9168fba54c92b529bf6efe48d7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:07.701091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-65eb6e19-c4d4-4e26-9073-e7b874266293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:07.764757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:07.769238 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1394/2785] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:07.781299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:07.783347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:07.860011 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222f988-77a1-440e-b1d9-14126686ee9f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:07.864168 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ce521-b569-47db-909d-55e73ab902db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:07.864746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ce521-b569-47db-909d-55e73ab902db service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:07.865038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ce521-b569-47db-909d-55e73ab902db service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:07.865315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ce521-b569-47db-909d-55e73ab902db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:07.874890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ce521-b569-47db-909d-55e73ab902db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:07.876318 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ce521-b569-47db-909d-55e73ab902db service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:07.885595 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1392/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:08.260473 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6e19-c4d4-4e26-9073-e7b874266293 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:08.320816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6e19-c4d4-4e26-9073-e7b874266293 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:08.325313 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:08.325933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:08.326216 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:08.326492 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] PATH_INFO: `/v3/users/ec9b5d995e6f4844a207cb1710116782` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:08.327620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9b5d995e6f4844a207cb1710116782)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:08.329561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:08.376511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9b5d995e6f4844a207cb1710116782'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.377094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9b5d995e6f4844a207cb1710116782'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.383907 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9b5d995e6f4844a207cb1710116782'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.384573 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9b5d995e6f4844a207cb1710116782'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.391551 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9b5d995e6f4844a207cb1710116782'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.408308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1395/2787] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:08 2022] DELETE /identity/v3/users/ec9b5d995e6f4844a207cb1710116782 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:06:08.412788 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:08.413246 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:08.413361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:08.431838 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:08.433063 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:08.478805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:08.494068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1393/2788] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:08.504352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:08.505776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:08.563529 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb778b19-7e2d-4cde-9e24-63b9d1009291 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:08.567135 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:08.567732 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:08.568010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:08.568283 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:08.577394 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:08.578863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:08.588302 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1396/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:08.853738 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:08.855267 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:08.868447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb816-b601-4133-a5ee-29262dec0d34 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:08.873384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:08.874120 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:08.874453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:08.874731 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] PATH_INFO: `/v3/projects/298386093bf746a7b975a408d59dfd12` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:08.875863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298386093bf746a7b975a408d59dfd12)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:08.877850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:08.923659 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298386093bf746a7b975a408d59dfd12', 'request_id': 'req-12b99387-d5f1-4864-b98f-c367a7a8b4d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.929603 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298386093bf746a7b975a408d59dfd12', 'request_id': 'req-12b99387-d5f1-4864-b98f-c367a7a8b4d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.938170 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298386093bf746a7b975a408d59dfd12', 'request_id': 'req-12b99387-d5f1-4864-b98f-c367a7a8b4d4'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.949598 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] The token cache is being invalidate because project 298386093bf746a7b975a408d59dfd12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:08.949889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.950525 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:08.952549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1394/2790] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:08 2022] DELETE /identity/v3/projects/298386093bf746a7b975a408d59dfd12 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:08.956668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:08.968997 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff2311-31e8-4589-8d82-19fe10a0f673 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:08.986779 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:09.028372 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.029013 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.029288 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.029558 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] PATH_INFO: `/v3/users/65dd9168fba54c92b529bf6efe48d7b2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.031331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65dd9168fba54c92b529bf6efe48d7b2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.033290 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.076433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65dd9168fba54c92b529bf6efe48d7b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.077852 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65dd9168fba54c92b529bf6efe48d7b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.084568 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65dd9168fba54c92b529bf6efe48d7b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.085194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65dd9168fba54c92b529bf6efe48d7b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.092278 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0be6fc35-9c18-4133-8307-09e50a352fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65dd9168fba54c92b529bf6efe48d7b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.109433 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1397/2791] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:08 2022] DELETE /identity/v3/users/65dd9168fba54c92b529bf6efe48d7b2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:09.370026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:09.371562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:09.388049 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b99387-d5f1-4864-b98f-c367a7a8b4d4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:09.446748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.447442 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.447646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.447917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] PATH_INFO: `/v3/projects/4d9aa255b67c4a91857f5b848811bc75` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.449067 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9aa255b67c4a91857f5b848811bc75)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.450943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.497479 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9aa255b67c4a91857f5b848811bc75', 'request_id': 'req-21778981-513a-4bf3-8eb5-502e9c63beea'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.503332 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9aa255b67c4a91857f5b848811bc75', 'request_id': 'req-21778981-513a-4bf3-8eb5-502e9c63beea'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.510350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9aa255b67c4a91857f5b848811bc75', 'request_id': 'req-21778981-513a-4bf3-8eb5-502e9c63beea'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.521539 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] The token cache is being invalidate because project 4d9aa255b67c4a91857f5b848811bc75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:09.521821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.522435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-21778981-513a-4bf3-8eb5-502e9c63beea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:09.523920 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1395/2792] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:09 2022] DELETE /identity/v3/projects/4d9aa255b67c4a91857f5b848811bc75 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:09.528945 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da4f0-334a-4ef5-bb7d-ab179dcafe0d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.529404 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da4f0-334a-4ef5-bb7d-ab179dcafe0d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.529520 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da4f0-334a-4ef5-bb7d-ab179dcafe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.548610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-b67da4f0-334a-4ef5-bb7d-ab179dcafe0d None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:09.549811 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-b67da4f0-334a-4ef5-bb7d-ab179dcafe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:09.609092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1398/2793] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:09.616934 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6750-0cd4-4263-b3ee-7d95233978d3 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.617247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6750-0cd4-4263-b3ee-7d95233978d3 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.617581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6750-0cd4-4263-b3ee-7d95233978d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.627355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:09.640044 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e79b6750-0cd4-4263-b3ee-7d95233978d3 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:09.641459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e79b6750-0cd4-4263-b3ee-7d95233978d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:09.649384 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1396/2794] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:09.653484 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da4f0-334a-4ef5-bb7d-ab179dcafe0d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:09.663174 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da4f0-334a-4ef5-bb7d-ab179dcafe0d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:09.668181 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.668804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.669079 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.669348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.669986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:06:09.670791 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.672563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.684502 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1399/2795] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:06:09.689386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b6750-0cd4-4263-b3ee-7d95233978d3 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:09.698830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b6750-0cd4-4263-b3ee-7d95233978d3 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:09.703433 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.704029 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.704309 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.704615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.705245 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.707122 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.734220 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1397/2796] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:09 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:06:09.738309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:09.748208 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880bd6a-b5e1-42d8-a48a-83d8154d34bf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:09.773841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:09.805621 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.806221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.806498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.806777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.807400 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.809337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.829868 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1400/2797] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:09 2022] POST /identity/v3/users => generated 281 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:09.833948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:09.844287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad876fa-c13a-4d0d-afcd-81d23f6a2a91 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:09.848802 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.849392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.849668 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.849951 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.850596 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.852172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.862986 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1398/2798] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:09.867027 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:09.877364 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37435a-83e9-454b-8ffa-94bce1bc99b0 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:09.881892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e1484-b466-4527-8138-9737e073c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.882487 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1484-b466-4527-8138-9737e073c150 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.882769 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1484-b466-4527-8138-9737e073c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.883044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1484-b466-4527-8138-9737e073c150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.883680 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e1484-b466-4527-8138-9737e073c150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.885306 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e1484-b466-4527-8138-9737e073c150 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.895594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1401/2799] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:09.899601 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:09.909405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fbf0f-62ee-4e0d-a8bf-c03d368432a4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:09.914094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:09.914744 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.915030 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.915311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] PATH_INFO: `/v3/projects/7a3373d82fec491c9d09a6d2b4df8209/users/1fc2f2433833475180f8c005cb3fb0a4/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.930150 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3373d82fec491c9d09a6d2b4df8209, user_id=1fc2f2433833475180f8c005cb3fb0a4, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:09.932815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:09.945898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1399/2800] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:09 2022] PUT /identity/v3/projects/7a3373d82fec491c9d09a6d2b4df8209/users/1fc2f2433833475180f8c005cb3fb0a4/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:09.956120 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b113-5f13-4d1d-894a-fcb3f995900d None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:09.956479 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b113-5f13-4d1d-894a-fcb3f995900d None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:09.956760 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b113-5f13-4d1d-894a-fcb3f995900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:09.984213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-9b01b113-5f13-4d1d-894a-fcb3f995900d None None] MFA Rules not processed for user `1fc2f2433833475180f8c005cb3fb0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:09.985545 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-9b01b113-5f13-4d1d-894a-fcb3f995900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:10.050606 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1402/2801] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:10.054999 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.114912 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03ce58-44f0-4cbb-8aa8-07b50bbfbcbf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.119490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.120089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.120372 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.120679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.121299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.123183 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.148485 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1400/2802] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:10 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:10.152598 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b113-5f13-4d1d-894a-fcb3f995900d None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.163672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b113-5f13-4d1d-894a-fcb3f995900d None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.218062 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.218658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.218933 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.219201 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.219838 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.221766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.243140 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1403/2803] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:10 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:10.247130 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.257329 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064d606-1849-478e-a1aa-84671f424936 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.262000 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.262597 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.262881 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.263157 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.263829 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.265446 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.275707 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1401/2804] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:10.280541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.290702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c69de-f11d-4775-b35e-1c2851a667bc admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.296033 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.296800 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.297145 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.297423 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] PATH_INFO: `/v3/projects/85c69bdfb59d4c0ca528e5e72429d771/users/75c4a72341134b3a93cc6893d2ad9567/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.312143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c69bdfb59d4c0ca528e5e72429d771, user_id=75c4a72341134b3a93cc6893d2ad9567, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.314804 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.327094 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1404/2805] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:10 2022] PUT /identity/v3/projects/85c69bdfb59d4c0ca528e5e72429d771/users/75c4a72341134b3a93cc6893d2ad9567/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:10.331088 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.341672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275563c6-14b7-40ed-8c9e-511a4c990d95 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.395846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4045d-28ca-4380-ad15-03f1520ef9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.396469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4045d-28ca-4380-ad15-03f1520ef9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.396749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4045d-28ca-4380-ad15-03f1520ef9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.397022 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4045d-28ca-4380-ad15-03f1520ef9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.397653 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4045d-28ca-4380-ad15-03f1520ef9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.399214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4045d-28ca-4380-ad15-03f1520ef9f8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.408995 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1402/2806] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:10.413107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.418347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:10.425309 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186476a1-cdf5-4ec2-af08-40dcb3f18146 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.430217 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.430863 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.431134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.431436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] PATH_INFO: `/v3/projects/85c69bdfb59d4c0ca528e5e72429d771/users/75c4a72341134b3a93cc6893d2ad9567/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.433383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85c69bdfb59d4c0ca528e5e72429d771, user_id=75c4a72341134b3a93cc6893d2ad9567, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.436024 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.447132 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1405/2807] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:10 2022] PUT /identity/v3/projects/85c69bdfb59d4c0ca528e5e72429d771/users/75c4a72341134b3a93cc6893d2ad9567/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:10.458970 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9fa0-7bd8-4ec0-a9a3-fcddb4601b23 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.459474 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9fa0-7bd8-4ec0-a9a3-fcddb4601b23 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.459613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9fa0-7bd8-4ec0-a9a3-fcddb4601b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.480711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:10.488824 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-da8b9fa0-7bd8-4ec0-a9a3-fcddb4601b23 None None] MFA Rules not processed for user `75c4a72341134b3a93cc6893d2ad9567`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:10.490268 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-da8b9fa0-7bd8-4ec0-a9a3-fcddb4601b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:10.555684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1403/2808] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:10.566692 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.568406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:10.626733 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbb107-c587-43c0-96ea-542736e88b4d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.630383 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.630986 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.631266 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.631562 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.640841 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.642275 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.651350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1406/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:10.728214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b9fa0-7bd8-4ec0-a9a3-fcddb4601b23 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:10.737640 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b9fa0-7bd8-4ec0-a9a3-fcddb4601b23 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:10.741195 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadf5ba-cb73-4b2f-ac73-809c0911be0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:10.741787 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf5ba-cb73-4b2f-ac73-809c0911be0b service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:10.742065 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf5ba-cb73-4b2f-ac73-809c0911be0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:10.742335 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadf5ba-cb73-4b2f-ac73-809c0911be0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:10.798326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadf5ba-cb73-4b2f-ac73-809c0911be0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:10.799748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadf5ba-cb73-4b2f-ac73-809c0911be0b service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:10.808289 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1404/2810] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:13.512842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:13.574796 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df25d2-b814-4a17-82a4-c902b3421152 service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:13.579965 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:13.580665 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:13.580949 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:13.581224 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] PATH_INFO: `/v3/users/1fc2f2433833475180f8c005cb3fb0a4` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:13.582360 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc2f2433833475180f8c005cb3fb0a4)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:13.584295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:13.629590 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc2f2433833475180f8c005cb3fb0a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:13.630222 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc2f2433833475180f8c005cb3fb0a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:13.637087 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc2f2433833475180f8c005cb3fb0a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:13.637704 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc2f2433833475180f8c005cb3fb0a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:13.645233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc2f2433833475180f8c005cb3fb0a4'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:13.662912 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1407/2811] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:13 2022] DELETE /identity/v3/users/1fc2f2433833475180f8c005cb3fb0a4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:13.667678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:13.668158 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:13.668263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:13.686711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:13.687892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:13.744313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1405/2812] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:06:13.754178 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:13.755572 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:13.769850 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:13.815587 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3d844-cb14-4107-bf01-50f76b4e8edf admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:13.819205 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:13.819810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:13.820091 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:13.820365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:13.829851 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:13.831279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:13.840639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1408/2813] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:14.110258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:14.111673 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:14.124960 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7febe01-170f-4fc4-9f4a-a6bb29181a7b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:14.129683 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:14.130321 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:14.130615 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:14.130889 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] PATH_INFO: `/v3/projects/7a3373d82fec491c9d09a6d2b4df8209` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:14.132018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3373d82fec491c9d09a6d2b4df8209)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:14.133956 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:14.168404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:14.182070 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3373d82fec491c9d09a6d2b4df8209', 'request_id': 'req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.188845 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3373d82fec491c9d09a6d2b4df8209', 'request_id': 'req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.196645 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3373d82fec491c9d09a6d2b4df8209', 'request_id': 'req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.207611 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] The token cache is being invalidate because project 7a3373d82fec491c9d09a6d2b4df8209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:14.207898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.208556 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.210018 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1406/2814] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:14 2022] DELETE /identity/v3/projects/7a3373d82fec491c9d09a6d2b4df8209 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:14.214160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:14.224124 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888479-3676-4ee3-9f4c-2d649453f809 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:14.279641 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:14.280265 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:14.280575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:14.280848 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] PATH_INFO: `/v3/users/75c4a72341134b3a93cc6893d2ad9567` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:14.281960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c4a72341134b3a93cc6893d2ad9567)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:14.283860 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:14.328711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c4a72341134b3a93cc6893d2ad9567'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.329350 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c4a72341134b3a93cc6893d2ad9567'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.336666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c4a72341134b3a93cc6893d2ad9567'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.337296 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c4a72341134b3a93cc6893d2ad9567'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.344960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8977ca03-4f58-45a5-9525-1a0aaa3d9270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c4a72341134b3a93cc6893d2ad9567'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.362740 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1409/2815] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:14 2022] DELETE /identity/v3/users/75c4a72341134b3a93cc6893d2ad9567 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:14.629462 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:14.630890 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:14.643756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf74cd8-b4d2-45be-9a1e-197c7a6ad953 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:14.699182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:14.699898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:14.700068 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:14.700347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] PATH_INFO: `/v3/projects/85c69bdfb59d4c0ca528e5e72429d771` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:14.701499 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85c69bdfb59d4c0ca528e5e72429d771)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:14.703357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:14.749763 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85c69bdfb59d4c0ca528e5e72429d771', 'request_id': 'req-8b65141e-eb16-499c-b477-5734c6cd0db7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.755279 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85c69bdfb59d4c0ca528e5e72429d771', 'request_id': 'req-8b65141e-eb16-499c-b477-5734c6cd0db7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.762511 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85c69bdfb59d4c0ca528e5e72429d771', 'request_id': 'req-8b65141e-eb16-499c-b477-5734c6cd0db7'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.773445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] The token cache is being invalidate because project 85c69bdfb59d4c0ca528e5e72429d771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:14.773768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.774399 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-8b65141e-eb16-499c-b477-5734c6cd0db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:14.775850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1407/2816] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:14 2022] DELETE /identity/v3/projects/85c69bdfb59d4c0ca528e5e72429d771 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 09:06:14.782267 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdba52-8a71-4473-b7a6-d8fc4f6300de None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:14.782725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdba52-8a71-4473-b7a6-d8fc4f6300de None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:14.782847 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdba52-8a71-4473-b7a6-d8fc4f6300de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:14.801974 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d9cdba52-8a71-4473-b7a6-d8fc4f6300de None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:14.803212 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d9cdba52-8a71-4473-b7a6-d8fc4f6300de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:14.830609 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:14.863501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1410/2817] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:14.872228 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb334-e04a-4582-bee2-9b3894e32c45 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:14.872625 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb334-e04a-4582-bee2-9b3894e32c45 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:14.872967 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eb334-e04a-4582-bee2-9b3894e32c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:14.892259 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-657eb334-e04a-4582-bee2-9b3894e32c45 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:14.893495 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-657eb334-e04a-4582-bee2-9b3894e32c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:14.901368 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1408/2818] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:14.906130 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdba52-8a71-4473-b7a6-d8fc4f6300de None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:14.915688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdba52-8a71-4473-b7a6-d8fc4f6300de None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:14.920720 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:14.921310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:14.921588 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:14.921858 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:14.922495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:06:14.922795 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:14.924375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:14.935636 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1411/2819] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:06:14.939773 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eb334-e04a-4582-bee2-9b3894e32c45 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:14.949004 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657eb334-e04a-4582-bee2-9b3894e32c45 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:14.954064 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:14.954657 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:14.954938 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:14.955213 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:14.955841 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:14.957749 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:14.985098 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1409/2820] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:14 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:06:14.989168 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:14.999117 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a94a3e-b495-4e72-9fff-147e06356501 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.054774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.055308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.055603 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.055862 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.056503 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.058421 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.081218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1412/2821] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:14 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:15.085353 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.096171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04427b0c-ab37-4da6-93a5-aed186aea00f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.100774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.101365 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.101644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.101915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.102549 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.104126 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.113734 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1410/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:15.117768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.127688 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2545e-7ba0-4783-9013-790189a73c62 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.132672 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f2340-ee81-4904-a374-7952d068e175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.133268 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2340-ee81-4904-a374-7952d068e175 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.133575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2340-ee81-4904-a374-7952d068e175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.133849 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f2340-ee81-4904-a374-7952d068e175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.134614 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2340-ee81-4904-a374-7952d068e175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.136221 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f2340-ee81-4904-a374-7952d068e175 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.147128 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1413/2823] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:15.151160 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.162037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a951d2b-512f-4f29-8e1c-ea521caac431 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.166926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.167719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.168055 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.168460 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] PATH_INFO: `/v3/projects/7885b800998b44f9bdd99a6107d96560/users/a04fca0eb448482c87dd4efca6801f0c/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.171648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:15.186637 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7885b800998b44f9bdd99a6107d96560, user_id=a04fca0eb448482c87dd4efca6801f0c, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.189360 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.202364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1411/2824] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:15 2022] PUT /identity/v3/projects/7885b800998b44f9bdd99a6107d96560/users/a04fca0eb448482c87dd4efca6801f0c/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:15.213151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fee45-0781-444c-a7c6-0b4a4bb42d94 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.213436 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fee45-0781-444c-a7c6-0b4a4bb42d94 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.213711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fee45-0781-444c-a7c6-0b4a4bb42d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.240975 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-811fee45-0781-444c-a7c6-0b4a4bb42d94 None None] MFA Rules not processed for user `a04fca0eb448482c87dd4efca6801f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:15.242162 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-811fee45-0781-444c-a7c6-0b4a4bb42d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:15.303981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1414/2825] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:15.308678 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.369076 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e82b6c-7437-47e6-bca5-0d6e12657d1a admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.374080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.374675 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.374953 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.375223 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.375842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.377755 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.403258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1412/2826] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:15 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:15.407514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fee45-0781-444c-a7c6-0b4a4bb42d94 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.417818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fee45-0781-444c-a7c6-0b4a4bb42d94 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.443755 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:15.475951 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.476594 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.476873 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.477144 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.477770 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.479671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.505722 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1415/2827] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:15 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:15.509768 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.521340 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91499b-4ac1-414d-addb-20359a0fcf62 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.525907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.526504 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.526785 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.527060 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.527697 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.529383 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.539774 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1413/2828] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:15.543944 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.554366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b1897-9122-4d05-9e81-08870d130672 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.559689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.560273 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.561086 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.561355 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] PATH_INFO: `/v3/projects/342a0d571d344557a821dabeb3087110/users/9792291f6d804a9c9833858a00df56ce/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.578393 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342a0d571d344557a821dabeb3087110, user_id=9792291f6d804a9c9833858a00df56ce, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.581171 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.594521 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1416/2829] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:15 2022] PUT /identity/v3/projects/342a0d571d344557a821dabeb3087110/users/9792291f6d804a9c9833858a00df56ce/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:15.598491 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.608533 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175d52-1ff6-4d2b-aa06-ac979737dc49 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.663505 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b143f7e-b170-4bc8-a749-7245a41c9953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.664104 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b143f7e-b170-4bc8-a749-7245a41c9953 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.664410 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b143f7e-b170-4bc8-a749-7245a41c9953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.664683 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b143f7e-b170-4bc8-a749-7245a41c9953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.665351 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b143f7e-b170-4bc8-a749-7245a41c9953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.666926 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b143f7e-b170-4bc8-a749-7245a41c9953 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.676996 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1414/2830] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:15.681150 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.691828 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f090a2b-80a9-4a58-9618-3d923da0d629 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.696293 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.696962 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.697259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.697508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] PATH_INFO: `/v3/projects/342a0d571d344557a821dabeb3087110/users/9792291f6d804a9c9833858a00df56ce/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.699406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342a0d571d344557a821dabeb3087110, user_id=9792291f6d804a9c9833858a00df56ce, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.702019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.711744 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1417/2831] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:15 2022] PUT /identity/v3/projects/342a0d571d344557a821dabeb3087110/users/9792291f6d804a9c9833858a00df56ce/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:15.723109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980db0c-1db6-44a0-aacf-a99c4d58c73a None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.723610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980db0c-1db6-44a0-aacf-a99c4d58c73a None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.723712 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980db0c-1db6-44a0-aacf-a99c4d58c73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.752588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-b980db0c-1db6-44a0-aacf-a99c4d58c73a None None] MFA Rules not processed for user `9792291f6d804a9c9833858a00df56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:15.753781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-b980db0c-1db6-44a0-aacf-a99c4d58c73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:15.796113 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:15.822334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1415/2832] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:15.833546 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:15.835340 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:15.905068 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae9f1-c49d-407d-82a0-7589f23e2aa4 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:15.908728 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:15.909333 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:15.909610 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:15.909882 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:15.919226 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:15.921169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:15.930380 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1418/2833] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:16.011683 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980db0c-1db6-44a0-aacf-a99c4d58c73a None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:16.021221 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980db0c-1db6-44a0-aacf-a99c4d58c73a None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:16.024834 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3cb86-d76b-4b78-9d1f-1df1fd5bc64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:16.025439 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3cb86-d76b-4b78-9d1f-1df1fd5bc64d service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:16.025733 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3cb86-d76b-4b78-9d1f-1df1fd5bc64d service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:16.026008 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3cb86-d76b-4b78-9d1f-1df1fd5bc64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:16.082870 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3cb86-d76b-4b78-9d1f-1df1fd5bc64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:16.084226 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3cb86-d76b-4b78-9d1f-1df1fd5bc64d service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:16.093907 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1416/2834] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:20.770009 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:20.831685 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb65a9-a6e8-460c-8863-c8be3674a65e service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:20.836113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:20.836776 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:20.837377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:20.837377 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] PATH_INFO: `/v3/users/a04fca0eb448482c87dd4efca6801f0c` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:20.838438 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04fca0eb448482c87dd4efca6801f0c)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:20.840326 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:20.867366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:20.888012 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04fca0eb448482c87dd4efca6801f0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:20.889263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04fca0eb448482c87dd4efca6801f0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:20.896240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04fca0eb448482c87dd4efca6801f0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:20.896908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04fca0eb448482c87dd4efca6801f0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:20.904203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04fca0eb448482c87dd4efca6801f0c'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:20.922019 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1419/2835] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:20 2022] DELETE /identity/v3/users/a04fca0eb448482c87dd4efca6801f0c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:20.926644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:20.927182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:20.927182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:20.946036 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:20.947229 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:21.004450 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1417/2836] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:21.014156 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:21.015555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:21.070496 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a566e1b-d90b-4a16-9f39-20d33111c9a8 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:21.074055 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:21.074648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:21.074925 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:21.075194 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:21.084365 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:21.085766 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:21.095240 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1420/2837] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:21.362463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:21.364058 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:21.377127 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a45759-abd8-42e5-b1b3-a5d5fd46efa9 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:21.381917 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:21.382612 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:21.383428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:21.383428 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] PATH_INFO: `/v3/projects/7885b800998b44f9bdd99a6107d96560` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:21.384371 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7885b800998b44f9bdd99a6107d96560)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:21.386429 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:21.433208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7885b800998b44f9bdd99a6107d96560', 'request_id': 'req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.438680 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7885b800998b44f9bdd99a6107d96560', 'request_id': 'req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.446330 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7885b800998b44f9bdd99a6107d96560', 'request_id': 'req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.457337 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] The token cache is being invalidate because project 7885b800998b44f9bdd99a6107d96560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:21.457627 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.458261 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.459745 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1418/2838] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:21 2022] DELETE /identity/v3/projects/7885b800998b44f9bdd99a6107d96560 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:21.463929 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:21.474419 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0919c2-0723-47de-816e-f8cf17528779 service neutron] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:21.530444 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:21.531088 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:21.531371 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:21.531675 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] PATH_INFO: `/v3/users/9792291f6d804a9c9833858a00df56ce` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:21.532855 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9792291f6d804a9c9833858a00df56ce)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:21.534801 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:21.588187 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9792291f6d804a9c9833858a00df56ce'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.588818 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9792291f6d804a9c9833858a00df56ce'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.590075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:21.598926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9792291f6d804a9c9833858a00df56ce'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.599830 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9792291f6d804a9c9833858a00df56ce'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.607957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-8e1ebee3-7124-414c-993f-deb57d8f5f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9792291f6d804a9c9833858a00df56ce'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:21.625107 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1421/2839] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:21 2022] DELETE /identity/v3/users/9792291f6d804a9c9833858a00df56ce => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:21.889435 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:21.890937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:21.899238 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:21.905781 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2a29e-00fe-4df5-8f4b-cc7ff9bb7d8d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:21.964331 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:21.965003 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:21.965256 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:21.965554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] PATH_INFO: `/v3/projects/342a0d571d344557a821dabeb3087110` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:21.967516 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=342a0d571d344557a821dabeb3087110)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:21.969486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.013739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342a0d571d344557a821dabeb3087110', 'request_id': 'req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:22.019214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342a0d571d344557a821dabeb3087110', 'request_id': 'req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:22.026569 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342a0d571d344557a821dabeb3087110', 'request_id': 'req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:22.038149 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] The token cache is being invalidate because project 342a0d571d344557a821dabeb3087110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:22.038438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:22.039118 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-b4d91d1e-7c5e-461f-b5e0-3b948bcb69c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:22.040650 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1419/2840] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:21 2022] DELETE /identity/v3/projects/342a0d571d344557a821dabeb3087110 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:22.045941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14f31-1272-4726-9059-9738d8c57452 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.046441 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14f31-1272-4726-9059-9738d8c57452 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.046540 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce14f31-1272-4726-9059-9738d8c57452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.065742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-fce14f31-1272-4726-9059-9738d8c57452 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:22.066919 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-fce14f31-1272-4726-9059-9738d8c57452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:22.125359 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1422/2841] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:22.133355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb4881-db77-4323-a176-125c203a4ee8 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.133586 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb4881-db77-4323-a176-125c203a4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.133863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb4881-db77-4323-a176-125c203a4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.153739 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-97fb4881-db77-4323-a176-125c203a4ee8 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:22.154979 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-97fb4881-db77-4323-a176-125c203a4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:22.162826 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1420/2842] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:22.167045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce14f31-1272-4726-9059-9738d8c57452 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.176607 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce14f31-1272-4726-9059-9738d8c57452 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.181176 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.181767 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.182047 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.182317 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] PATH_INFO: `/v3/domains` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.182960 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:06:22.183262 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.185022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.197163 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1423/2843] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 09:06:22.202208 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb4881-db77-4323-a176-125c203a4ee8 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.211571 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb4881-db77-4323-a176-125c203a4ee8 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.216672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.217284 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.217562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.217830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.218456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.220357 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.246699 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1421/2844] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:22 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:22.251143 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.260901 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc94b59-3ba1-4043-ad15-01bda904765f admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.316134 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.316786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.317066 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.317337 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.317957 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.319861 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.341111 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1424/2845] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:22 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:22.345273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.355420 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787d8b2-5167-463e-817c-8160640fab34 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.359941 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.360591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.360877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.361154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.361801 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.363388 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.373562 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1422/2846] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:22.377462 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.387271 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f72330-36bb-4c5d-88c9-ec4bb7c92bb5 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.392352 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488638b-7ac5-412c-b915-054250ca4c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.392964 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488638b-7ac5-412c-b915-054250ca4c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.393242 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488638b-7ac5-412c-b915-054250ca4c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.393512 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488638b-7ac5-412c-b915-054250ca4c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.394172 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488638b-7ac5-412c-b915-054250ca4c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.395792 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488638b-7ac5-412c-b915-054250ca4c92 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.406250 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1425/2847] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:22.410456 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.420646 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8271e6e-3d1d-48d6-a414-1205af6ba14f admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.425251 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.425893 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.426171 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.426443 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] PATH_INFO: `/v3/projects/19b66e5c29274c9399f58c2784533ef4/users/1b2906128dac4e568f88314f25161599/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.441094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b66e5c29274c9399f58c2784533ef4, user_id=1b2906128dac4e568f88314f25161599, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.443711 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.456181 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1423/2848] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:22 2022] PUT /identity/v3/projects/19b66e5c29274c9399f58c2784533ef4/users/1b2906128dac4e568f88314f25161599/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:22.520331 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22613-df45-458d-b19c-24b93c5b3a57 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.520725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22613-df45-458d-b19c-24b93c5b3a57 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.521021 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e22613-df45-458d-b19c-24b93c5b3a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.549446 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-53e22613-df45-458d-b19c-24b93c5b3a57 None None] MFA Rules not processed for user `1b2906128dac4e568f88314f25161599`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:22.550648 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-53e22613-df45-458d-b19c-24b93c5b3a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:22.569010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:22.617218 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1426/2849] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:22.621658 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.652263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:22.684914 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed82e9-c95b-468c-ac53-5bf2e195172d admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.690184 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.690794 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.691078 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.691355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.691976 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.693933 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.721862 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1424/2850] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:22 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:22.725920 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22613-df45-458d-b19c-24b93c5b3a57 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.737183 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e22613-df45-458d-b19c-24b93c5b3a57 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.792459 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.793064 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.793347 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.793622 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] PATH_INFO: `/v3/users` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.794241 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.796826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.816952 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1427/2851] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:22 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:22.820978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.831258 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cdef8-ce38-4d1a-9173-bf20e4e632a4 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.835897 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.836532 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.836815 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.837089 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.837732 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.839347 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.849837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1425/2852] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:22.853978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.864673 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5694503-a0d7-454a-941a-20d5f69af3df admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.869353 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.869998 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.870282 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.870561 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] PATH_INFO: `/v3/projects/3360f6e9cfe34140884d853d672fe1b2/users/5cbc896f2ba6454f84ee033c23cc7790/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.884890 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3360f6e9cfe34140884d853d672fe1b2, user_id=5cbc896f2ba6454f84ee033c23cc7790, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.887644 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.900056 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1428/2853] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:22 2022] PUT /identity/v3/projects/3360f6e9cfe34140884d853d672fe1b2/users/5cbc896f2ba6454f84ee033c23cc7790/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:22.904805 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.914554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed510548-4d96-4fe9-8971-1580ec4fd2d8 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:22.970317 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70792d-cba3-4df8-81d0-6d0ad09d7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:22.970927 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70792d-cba3-4df8-81d0-6d0ad09d7238 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:22.971188 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70792d-cba3-4df8-81d0-6d0ad09d7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:22.971463 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70792d-cba3-4df8-81d0-6d0ad09d7238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:22.972109 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70792d-cba3-4df8-81d0-6d0ad09d7238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:22.973725 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70792d-cba3-4df8-81d0-6d0ad09d7238 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:22.983676 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1426/2854] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:22.987941 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:22.998620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f5bf-88eb-43da-8d77-1f45e1477a42 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:23.003188 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:23.003829 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:23.004112 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:23.004420 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] PATH_INFO: `/v3/projects/3360f6e9cfe34140884d853d672fe1b2/users/5cbc896f2ba6454f84ee033c23cc7790/roles/759ce9628735416988d65affdc29c636` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:23.006334 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3360f6e9cfe34140884d853d672fe1b2, user_id=5cbc896f2ba6454f84ee033c23cc7790, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:23.008983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:23.019664 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1429/2855] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:22 2022] PUT /identity/v3/projects/3360f6e9cfe34140884d853d672fe1b2/users/5cbc896f2ba6454f84ee033c23cc7790/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:23.029458 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6763-25ed-485e-8c27-816ea037fe25 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:23.029735 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6763-25ed-485e-8c27-816ea037fe25 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:23.030035 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a6763-25ed-485e-8c27-816ea037fe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:23.056969 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-4e1a6763-25ed-485e-8c27-816ea037fe25 None None] MFA Rules not processed for user `5cbc896f2ba6454f84ee033c23cc7790`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:23.058191 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-4e1a6763-25ed-485e-8c27-816ea037fe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:23.124850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1427/2856] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:23.135627 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:23.137541 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:23.195059 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca18a7f-c96a-4eab-8b56-9788b101d80c admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:23.198751 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4399-eeba-481b-a090-ee6b031819aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:23.199351 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4399-eeba-481b-a090-ee6b031819aa service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:23.199634 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4399-eeba-481b-a090-ee6b031819aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:23.199906 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4399-eeba-481b-a090-ee6b031819aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:23.208742 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4399-eeba-481b-a090-ee6b031819aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:23.210169 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4399-eeba-481b-a090-ee6b031819aa service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:23.219678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1430/2857] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:23.586447 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a6763-25ed-485e-8c27-816ea037fe25 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:23.615786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:23.651139 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a6763-25ed-485e-8c27-816ea037fe25 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:23.656316 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:23.656982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:23.657266 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:23.657542 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] PATH_INFO: `/v3/users/1b2906128dac4e568f88314f25161599` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:23.658671 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2906128dac4e568f88314f25161599)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:23.660661 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:23.707395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2906128dac4e568f88314f25161599'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:23.707982 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2906128dac4e568f88314f25161599'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:23.708613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2906128dac4e568f88314f25161599'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:23.715552 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2906128dac4e568f88314f25161599'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:23.723767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2906128dac4e568f88314f25161599'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:23.741218 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1428/2858] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:23 2022] DELETE /identity/v3/users/1b2906128dac4e568f88314f25161599 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:23.745752 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:23.746044 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:23.746320 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:23.764497 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:23.765695 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:23.774724 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:23.825805 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1431/2859] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:23.835389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:23.836850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:23.893155 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25549ab-65e6-4ee8-a43e-fe7dcc984f64 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:23.896864 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:23.897473 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:23.897759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:23.898038 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:23.907500 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:23.908973 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:23.918230 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1429/2860] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:24.187095 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:24.188978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:24.201555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6775b-389c-4f5d-9ee3-a04e69269495 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:24.206182 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:24.206814 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:24.207098 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:24.207375 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] PATH_INFO: `/v3/projects/19b66e5c29274c9399f58c2784533ef4` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:24.208551 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b66e5c29274c9399f58c2784533ef4)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:24.210458 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:24.257026 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b66e5c29274c9399f58c2784533ef4', 'request_id': 'req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.262563 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b66e5c29274c9399f58c2784533ef4', 'request_id': 'req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.268689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b66e5c29274c9399f58c2784533ef4', 'request_id': 'req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.281330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] The token cache is being invalidate because project 19b66e5c29274c9399f58c2784533ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:24.281620 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.282249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.283710 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1432/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:24 2022] DELETE /identity/v3/projects/19b66e5c29274c9399f58c2784533ef4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:24.287746 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:24.297983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306aa33-eada-43f4-8502-9552727dffbb service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:24.341193 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:24.355392 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:24.356023 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:24.356304 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:24.356607 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] PATH_INFO: `/v3/users/5cbc896f2ba6454f84ee033c23cc7790` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:24.358322 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbc896f2ba6454f84ee033c23cc7790)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:24.360222 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:24.403559 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbc896f2ba6454f84ee033c23cc7790'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.404748 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbc896f2ba6454f84ee033c23cc7790'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.405350 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbc896f2ba6454f84ee033c23cc7790'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.412009 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbc896f2ba6454f84ee033c23cc7790'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.419007 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2b3cfdfe-cb42-4703-9878-ccb99f073659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbc896f2ba6454f84ee033c23cc7790'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.436233 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1430/2862] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:24 2022] DELETE /identity/v3/users/5cbc896f2ba6454f84ee033c23cc7790 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:24.708560 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:24.709984 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:24.723570 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc446a8-1898-4e98-b1b9-79735ecbc3b2 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:24.780915 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:24.781501 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:24.781781 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:24.782054 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] PATH_INFO: `/v3/projects/3360f6e9cfe34140884d853d672fe1b2` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:24.783207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3360f6e9cfe34140884d853d672fe1b2)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:24.785213 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:24.823857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:24.831196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3360f6e9cfe34140884d853d672fe1b2', 'request_id': 'req-33f0fb8f-3145-4a76-b508-c4b50a32d79f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.837090 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3360f6e9cfe34140884d853d672fe1b2', 'request_id': 'req-33f0fb8f-3145-4a76-b508-c4b50a32d79f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.844294 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3360f6e9cfe34140884d853d672fe1b2', 'request_id': 'req-33f0fb8f-3145-4a76-b508-c4b50a32d79f'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.856075 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] The token cache is being invalidate because project 3360f6e9cfe34140884d853d672fe1b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:24.856366 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.857092 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-33f0fb8f-3145-4a76-b508-c4b50a32d79f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:24.858793 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1433/2863] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:24 2022] DELETE /identity/v3/projects/3360f6e9cfe34140884d853d672fe1b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:24.864137 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b642-d40b-4988-9996-f85d0b4a1f97 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:24.864548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b642-d40b-4988-9996-f85d0b4a1f97 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:24.864894 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b642-d40b-4988-9996-f85d0b4a1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:24.887069 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-96a2b642-d40b-4988-9996-f85d0b4a1f97 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:24.888885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-96a2b642-d40b-4988-9996-f85d0b4a1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:24.945445 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1431/2864] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:06:24.953908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea3ae1-52f4-4f51-9b29-0231aab7b0f2 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:24.954202 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea3ae1-52f4-4f51-9b29-0231aab7b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:24.954486 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea3ae1-52f4-4f51-9b29-0231aab7b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:24.974693 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-50ea3ae1-52f4-4f51-9b29-0231aab7b0f2 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:24.975892 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-50ea3ae1-52f4-4f51-9b29-0231aab7b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:24.983678 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1434/2865] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:24.988107 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2b642-d40b-4988-9996-f85d0b4a1f97 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:24.997846 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2b642-d40b-4988-9996-f85d0b4a1f97 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.002453 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.003056 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.003343 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.003713 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.004364 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 09:06:25.004701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.006293 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.018325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1432/2866] 10.222.0.42 () {58 vars in 1153 bytes} [Wed Aug 24 09:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 09:06:25.022596 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea3ae1-52f4-4f51-9b29-0231aab7b0f2 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.032401 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea3ae1-52f4-4f51-9b29-0231aab7b0f2 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.036885 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.037475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.037754 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.038028 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.038668 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.040593 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.067618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1435/2867] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:25.071937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.082915 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55e9fd-88d7-4d50-b9a6-132258d674ba admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.129577 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:25.140016 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.140672 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.140943 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.141214 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.141836 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.143765 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.164313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1433/2868] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 09:06:25.168448 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.178711 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91c760-9f3a-412a-bc36-e45e3a91ecb6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.183542 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.184253 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.184640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.185666 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.186478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.188259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.198368 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1436/2869] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:25.202888 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.212786 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33f67-1c8a-4b4e-94e9-acdcbe819b84 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.217877 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23d47f-573c-4442-96f5-d43bb92bac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.218478 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d47f-573c-4442-96f5-d43bb92bac22 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.218759 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d47f-573c-4442-96f5-d43bb92bac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.219034 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23d47f-573c-4442-96f5-d43bb92bac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.219684 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d47f-573c-4442-96f5-d43bb92bac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.221355 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23d47f-573c-4442-96f5-d43bb92bac22 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.233154 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1434/2870] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:25.236942 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.246867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e71a66-a4bd-44ff-a10a-b385e982bfe1 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.251902 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.252577 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.252859 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.253131 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] PATH_INFO: `/v3/projects/1b0204b1fda742f1b227bf37d18d2ded/users/777e928e98cd43659157136878a0d412/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.267963 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0204b1fda742f1b227bf37d18d2ded, user_id=777e928e98cd43659157136878a0d412, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.270623 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.284093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1437/2871] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:25 2022] PUT /identity/v3/projects/1b0204b1fda742f1b227bf37d18d2ded/users/777e928e98cd43659157136878a0d412/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:25.295461 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6380df-1778-4692-886b-8a5ce4991b92 None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.295958 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6380df-1778-4692-886b-8a5ce4991b92 None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.296110 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6380df-1778-4692-886b-8a5ce4991b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.324021 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-6e6380df-1778-4692-886b-8a5ce4991b92 None None] MFA Rules not processed for user `777e928e98cd43659157136878a0d412`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:25.325286 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-6e6380df-1778-4692-886b-8a5ce4991b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:25.389660 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1435/2872] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:06:25.394161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.456645 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8705-5b20-4aa6-b054-1d9fac1b370d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.461239 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.461843 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.462234 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.462511 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.463127 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.465045 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.491564 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1438/2873] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:25.495743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6380df-1778-4692-886b-8a5ce4991b92 None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.506842 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6380df-1778-4692-886b-8a5ce4991b92 None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.562366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.562900 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.563185 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.563459 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.564086 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.566092 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.587811 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1436/2874] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:25.592199 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.603164 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed54b-7563-48c6-80ef-fa8e583e9b9e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.608329 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.608956 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.609263 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.609565 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.610277 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.611988 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.622670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1439/2875] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:25.626508 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.641756 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85367d-5c9a-41a7-a080-13e5c3b0813b admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.648840 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547c273-1ddc-45dc-826d-09f464935a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.649438 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c273-1ddc-45dc-826d-09f464935a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.649719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c273-1ddc-45dc-826d-09f464935a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.649997 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547c273-1ddc-45dc-826d-09f464935a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.650644 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547c273-1ddc-45dc-826d-09f464935a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.652262 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547c273-1ddc-45dc-826d-09f464935a80 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.662648 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1437/2876] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:25.666777 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.677330 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9478c6-9248-48ba-a954-147ab897652e admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.681816 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.682452 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] REQUEST_METHOD: `PUT` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.682725 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.682993 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] PATH_INFO: `/v3/projects/5801dde9e4364d85b8452b2931c2b901/users/41e2a49b575247d692f4b1c07c4c325e/roles/3a468bb5cd55417db77f4bb6f33b2817` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.698010 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5801dde9e4364d85b8452b2931c2b901, user_id=41e2a49b575247d692f4b1c07c4c325e, role_id=3a468bb5cd55417db77f4bb6f33b2817)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.700660 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.713412 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1440/2877] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:25 2022] PUT /identity/v3/projects/5801dde9e4364d85b8452b2931c2b901/users/41e2a49b575247d692f4b1c07c4c325e/roles/3a468bb5cd55417db77f4bb6f33b2817 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:25.724015 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83f9d3-4576-496f-8ab9-1f33df766e6b None None] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.724302 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83f9d3-4576-496f-8ab9-1f33df766e6b None None] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.724610 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83f9d3-4576-496f-8ab9-1f33df766e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.752524 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.auth.core [None req-7f83f9d3-4576-496f-8ab9-1f33df766e6b None None] MFA Rules not processed for user `41e2a49b575247d692f4b1c07c4c325e`. Rule list: `[]` (Enabled: `True`). {{(pid=81541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:25.753727 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-7f83f9d3-4576-496f-8ab9-1f33df766e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:25.782361 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:25.818885 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1438/2878] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 09:06:25.823258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.840478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:25.886677 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25701b07-5e40-4028-b5af-5b166ef4276d admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.891321 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.891926 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.892209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.892514 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] PATH_INFO: `/v3/projects` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.893147 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.895053 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:25.922576 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1441/2879] 10.222.0.42 () {60 vars in 1153 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:25.926325 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83f9d3-4576-496f-8ab9-1f33df766e6b None None] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:25.937037 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83f9d3-4576-496f-8ab9-1f33df766e6b None None] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:25.991887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:25.992617 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:25.992898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:25.993203 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:25.993922 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:25.996026 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:26.016594 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1439/2880] 10.222.0.42 () {60 vars in 1144 bytes} [Wed Aug 24 09:06:25 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 09:06:26.020764 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:26.031379 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933addc-4829-4ae9-b992-e56495f7584b admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:26.035867 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:26.036495 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:26.036774 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:26.037043 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:26.037706 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:26.039285 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:26.050113 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1442/2881] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:26.054097 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:26.064045 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fb9ee-7bed-4b77-8fdc-cb1ccdb13ff7 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:26.068624 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:26.069313 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:26.069548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:26.069821 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] PATH_INFO: `/v3/projects/92274b7b39894710afed0cf2be9ec06e/users/23589600008a4a1fbb5c9b253f3c9d34/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:26.084436 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92274b7b39894710afed0cf2be9ec06e, user_id=23589600008a4a1fbb5c9b253f3c9d34, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:26.087187 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:26.100886 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1440/2882] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:26 2022] PUT /identity/v3/projects/92274b7b39894710afed0cf2be9ec06e/users/23589600008a4a1fbb5c9b253f3c9d34/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:26.104786 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:26.115158 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cdf2f-363a-4d15-8626-169d5880b121 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:26.170773 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931917a-658c-4570-93a5-df5117598028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:26.171381 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931917a-658c-4570-93a5-df5117598028 admin admin] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:26.171661 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931917a-658c-4570-93a5-df5117598028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:26.171936 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931917a-658c-4570-93a5-df5117598028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:26.172619 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931917a-658c-4570-93a5-df5117598028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:26.174203 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931917a-658c-4570-93a5-df5117598028 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:26.184139 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1443/2883] 10.222.0.42 () {58 vars in 1122 bytes} [Wed Aug 24 09:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 09:06:26.188311 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:26.198466 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85768365-366e-4082-b04a-3397e8b49d58 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:26.203492 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:26.204144 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] REQUEST_METHOD: `PUT` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:26.204431 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:26.204709 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] PATH_INFO: `/v3/projects/92274b7b39894710afed0cf2be9ec06e/users/23589600008a4a1fbb5c9b253f3c9d34/roles/759ce9628735416988d65affdc29c636` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:26.206588 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92274b7b39894710afed0cf2be9ec06e, user_id=23589600008a4a1fbb5c9b253f3c9d34, role_id=759ce9628735416988d65affdc29c636)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:26.209273 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:26.222701 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1441/2884] 10.222.0.42 () {60 vars in 1483 bytes} [Wed Aug 24 09:06:26 2022] PUT /identity/v3/projects/92274b7b39894710afed0cf2be9ec06e/users/23589600008a4a1fbb5c9b253f3c9d34/roles/759ce9628735416988d65affdc29c636 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:26.234014 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:26.234508 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:26.234618 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:26.261566 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] MFA Rules not processed for user `23589600008a4a1fbb5c9b253f3c9d34`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:26.262768 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:26.329310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1444/2885] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:26.341111 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:26.343448 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:26.400404 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e02e7-d3f3-4a84-929b-6c376822a603 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:26.404831 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:26.405486 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:26.405798 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:26.406075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:26.438326 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:26.461315 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:26.462742 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:26.472366 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1442/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:27.969272 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:27.970657 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:27.983160 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ac433-263a-4760-9e48-bd806f7b6778 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:27.986686 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:27.987279 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:27.987555 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:27.987826 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:27.995842 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:28.046976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:28.048498 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:28.057535 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1445/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:28.586422 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:28.596080 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be514a-e4c1-4732-a2ec-166f1f6d0ed3 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:28.599700 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf830371223c4280902001e389cff3a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:28.600299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:28.600622 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:28.600901 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:28.609921 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:28.611334 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:28.620591 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1443/2888] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:31.253639 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:31.255179 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:31.315034 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fea550-1cdf-4e06-8951-3ce8e7083a8a service cinder] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:31.318880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ffb20f-152f-4b6f-8975-46d2c750cdf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:31.319478 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffb20f-152f-4b6f-8975-46d2c750cdf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:31.319753 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffb20f-152f-4b6f-8975-46d2c750cdf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:31.320029 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ffb20f-152f-4b6f-8975-46d2c750cdf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:31.321857 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-e8ffb20f-152f-4b6f-8975-46d2c750cdf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:31.333757 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffb20f-152f-4b6f-8975-46d2c750cdf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:31.335207 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ffb20f-152f-4b6f-8975-46d2c750cdf6 service neutron] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:31.344633 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1446/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:32.499770 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:32.561952 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f39c6-9237-4fd8-a851-91a1ddc5a303 service cinder] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:32.566405 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:32.567025 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:32.567306 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:32.567581 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] PATH_INFO: `/v3/users/777e928e98cd43659157136878a0d412` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:32.568719 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=777e928e98cd43659157136878a0d412)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:32.570613 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:32.617913 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777e928e98cd43659157136878a0d412'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:32.618566 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777e928e98cd43659157136878a0d412'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:32.619182 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777e928e98cd43659157136878a0d412'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:32.626490 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777e928e98cd43659157136878a0d412'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:32.633743 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777e928e98cd43659157136878a0d412'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:32.651469 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1444/2890] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:32 2022] DELETE /identity/v3/users/777e928e98cd43659157136878a0d412 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:32.655943 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] REQUEST_METHOD: `POST` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:32.656429 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:32.656532 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:32.675976 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.auth.core [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] MFA Rules not processed for user `683fbdc2cecc4c059e82825e29207432`. Rule list: `[]` (Enabled: `True`). {{(pid=81542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 09:06:32.677249 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:32.735389 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1447/2891] 10.222.0.42 () {58 vars in 958 bytes} [Wed Aug 24 09:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 09:06:32.744918 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:32.746367 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:32.792096 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:32.804767 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392029c-b13b-481a-ad14-982d5f44d6bf admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:32.808349 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7194e3fe0d2d46ada270bb440cd79911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:32.808975 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:32.809252 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:32.810053 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:32.818892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:32.820291 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:32.830124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1445/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:06:33.094406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:33.096472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:33.111110 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6b981-837b-411b-84d4-a4f67f5b6444 None None] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:33.115967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:33.116689 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:33.117025 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:33.117409 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] PATH_INFO: `/v3/projects/1b0204b1fda742f1b227bf37d18d2ded` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:33.118670 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0204b1fda742f1b227bf37d18d2ded)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:33.121152 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:33.166370 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:33.167554 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0204b1fda742f1b227bf37d18d2ded', 'request_id': 'req-0b747341-3a2c-4d75-9c4d-0405a0705fd6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.173978 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0204b1fda742f1b227bf37d18d2ded', 'request_id': 'req-0b747341-3a2c-4d75-9c4d-0405a0705fd6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.179983 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0204b1fda742f1b227bf37d18d2ded', 'request_id': 'req-0b747341-3a2c-4d75-9c4d-0405a0705fd6'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.193022 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] The token cache is being invalidate because project 1b0204b1fda742f1b227bf37d18d2ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:33.193310 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.193935 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.195591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1448/2893] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:33 2022] DELETE /identity/v3/projects/1b0204b1fda742f1b227bf37d18d2ded => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:33.199614 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:33.209898 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d73a0f-504a-4b22-bf4a-5193b897df8b service neutron] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:33.266263 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:33.266887 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:33.267172 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:33.267451 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] PATH_INFO: `/v3/users/41e2a49b575247d692f4b1c07c4c325e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:33.268602 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e2a49b575247d692f4b1c07c4c325e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:33.270554 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:33.315131 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e2a49b575247d692f4b1c07c4c325e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.315775 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e2a49b575247d692f4b1c07c4c325e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.316395 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e2a49b575247d692f4b1c07c4c325e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.323200 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e2a49b575247d692f4b1c07c4c325e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.330679 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e2a49b575247d692f4b1c07c4c325e'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.348164 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1446/2894] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:33 2022] DELETE /identity/v3/users/41e2a49b575247d692f4b1c07c4c325e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:33.619299 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:33.620778 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:33.634681 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b747341-3a2c-4d75-9c4d-0405a0705fd6 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:33.698971 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:33.699671 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:33.699870 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:33.700170 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] PATH_INFO: `/v3/projects/5801dde9e4364d85b8452b2931c2b901` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:33.701325 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5801dde9e4364d85b8452b2931c2b901)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:33.703258 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:33.761233 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5801dde9e4364d85b8452b2931c2b901', 'request_id': 'req-92fa2e2a-2113-498e-9fd5-0d2f054958b7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.766658 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5801dde9e4364d85b8452b2931c2b901', 'request_id': 'req-92fa2e2a-2113-498e-9fd5-0d2f054958b7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.772702 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5801dde9e4364d85b8452b2931c2b901', 'request_id': 'req-92fa2e2a-2113-498e-9fd5-0d2f054958b7'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.784803 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] The token cache is being invalidate because project 5801dde9e4364d85b8452b2931c2b901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:33.785097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.785844 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.787417 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1449/2895] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:33 2022] DELETE /identity/v3/projects/5801dde9e4364d85b8452b2931c2b901 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:33.791496 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:33.792850 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:33.805837 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a6c4-4d94-4854-9acb-9e3c0ac553d3 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:33.861616 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:33.862247 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:33.862530 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:33.862808 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] PATH_INFO: `/v3/users/23589600008a4a1fbb5c9b253f3c9d34` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:33.863954 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23589600008a4a1fbb5c9b253f3c9d34)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:33.865910 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:33.870374 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:33.913402 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23589600008a4a1fbb5c9b253f3c9d34'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.914050 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23589600008a4a1fbb5c9b253f3c9d34'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.914654 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23589600008a4a1fbb5c9b253f3c9d34'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.922335 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23589600008a4a1fbb5c9b253f3c9d34'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.929991 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23589600008a4a1fbb5c9b253f3c9d34'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:33.947807 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1447/2896] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:06:33 2022] DELETE /identity/v3/users/23589600008a4a1fbb5c9b253f3c9d34 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:34.216552 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:06:34.217967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:06:34.230981 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa2e2a-2113-498e-9fd5-0d2f054958b7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:06:34.288967 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:06:34.289602 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:06:34.289880 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:06:34.290151 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] PATH_INFO: `/v3/projects/92274b7b39894710afed0cf2be9ec06e` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:06:34.291259 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92274b7b39894710afed0cf2be9ec06e)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:06:34.293196 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:06:34.301097 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:34.342591 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92274b7b39894710afed0cf2be9ec06e', 'request_id': 'req-199497b6-ed69-4320-bbef-c3f746f4d997'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:34.348065 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92274b7b39894710afed0cf2be9ec06e', 'request_id': 'req-199497b6-ed69-4320-bbef-c3f746f4d997'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:34.354030 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92274b7b39894710afed0cf2be9ec06e', 'request_id': 'req-199497b6-ed69-4320-bbef-c3f746f4d997'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:34.365917 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] The token cache is being invalidate because project 92274b7b39894710afed0cf2be9ec06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:06:34.366200 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:34.366810 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:06:34.368255 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1450/2897] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:06:34 2022] DELETE /identity/v3/projects/92274b7b39894710afed0cf2be9ec06e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:06:43.944310 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:06:44.362908 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:05.726124 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:07:05.727386 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:07:05.810937 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cab55-5825-44de-abb6-13e2807b17f9 admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:07:05.886853 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a517cf1b373445fd9e98c4e703732153', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:07:05.887548 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] REQUEST_METHOD: `GET` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:07:05.887983 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:07:05.888255 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:07:05.890162 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:07:05.902830 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:07:05.904484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:07:05.917484 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1448/2898] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:07:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:07:15.781980 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:07:15.783516 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:07:15.847191 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199497b6-ed69-4320-bbef-c3f746f4d997 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:07:15.851635 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:07:15.852257 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:07:15.852575 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:07:15.852854 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] PATH_INFO: `/v3/users/20e6815fb4a74cec90300abf6a355a07` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:07:15.853958 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e6815fb4a74cec90300abf6a355a07)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:07:15.855864 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:07:15.900338 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e6815fb4a74cec90300abf6a355a07'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:15.901017 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e6815fb4a74cec90300abf6a355a07'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:15.908581 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e6815fb4a74cec90300abf6a355a07'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:15.909209 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e6815fb4a74cec90300abf6a355a07'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:15.914094 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=62 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:15.916876 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e6815fb4a74cec90300abf6a355a07'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:15.934295 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1451/2899] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:07:15 2022] DELETE /identity/v3/users/20e6815fb4a74cec90300abf6a355a07 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:07:16.117389 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:07:16.131075 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97296977-a5c0-4b25-b125-ad5f9aace188 service nova] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:07:16.191314 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:07:16.192134 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:07:16.192541 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:07:16.192892 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] PATH_INFO: `/v3/projects/3295460cf4a144958ef65b7c9808c79b` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:07:16.194039 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3295460cf4a144958ef65b7c9808c79b)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:07:16.196116 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:07:16.242695 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3295460cf4a144958ef65b7c9808c79b', 'request_id': 'req-2f65d733-6ec6-4315-8fcd-d49305ad49ee'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.248536 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3295460cf4a144958ef65b7c9808c79b', 'request_id': 'req-2f65d733-6ec6-4315-8fcd-d49305ad49ee'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.255694 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3295460cf4a144958ef65b7c9808c79b', 'request_id': 'req-2f65d733-6ec6-4315-8fcd-d49305ad49ee'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.267071 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] The token cache is being invalidate because project 3295460cf4a144958ef65b7c9808c79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:07:16.267358 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.267978 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.269467 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1449/2900] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:07:16 2022] DELETE /identity/v3/projects/3295460cf4a144958ef65b7c9808c79b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:07:16.273500 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:07:16.274959 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:07:16.288348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513c8e6-82dd-45df-89c9-2a4d1a36f1c7 admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:07:16.343979 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:07:16.344650 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:07:16.344931 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:07:16.345204 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] PATH_INFO: `/v3/users/91f530236e0c4e8d99c7d58707cc4224` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:07:16.346348 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f530236e0c4e8d99c7d58707cc4224)` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:07:16.348256 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:07:16.369161 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:16.395640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f530236e0c4e8d99c7d58707cc4224'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.396308 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f530236e0c4e8d99c7d58707cc4224'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.403640 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f530236e0c4e8d99c7d58707cc4224'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.404406 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f530236e0c4e8d99c7d58707cc4224'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.413472 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.notifications [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f530236e0c4e8d99c7d58707cc4224'} {{(pid=81542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.431709 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1452/2901] 10.222.0.42 () {58 vars in 1224 bytes} [Wed Aug 24 09:07:16 2022] DELETE /identity/v3/users/91f530236e0c4e8d99c7d58707cc4224 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:07:16.602283 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Authenticating user token {{(pid=81541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:07:16.603863 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.fernet_utils [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:07:16.619523 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65d733-6ec6-4315-8fcd-d49305ad49ee admin admin] Validating token access rules against request {{(pid=81541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:07:16.677572 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '683fbdc2cecc4c059e82825e29207432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99f84482a9b64bcfb8dae5485dc7545f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:07:16.678287 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:07:16.678570 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:07:16.678851 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] PATH_INFO: `/v3/projects/bd503c52c4b24dae9a0ad09f30208a8e` {{(pid=81541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:07:16.679971 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd503c52c4b24dae9a0ad09f30208a8e)` {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:07:16.681899 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] RBAC: Authorization granted {{(pid=81541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:07:16.716455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:16.730621 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd503c52c4b24dae9a0ad09f30208a8e', 'request_id': 'req-5c259761-70f2-42dc-8b71-3ff168066f28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.736911 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd503c52c4b24dae9a0ad09f30208a8e', 'request_id': 'req-5c259761-70f2-42dc-8b71-3ff168066f28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.744299 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd503c52c4b24dae9a0ad09f30208a8e', 'request_id': 'req-5c259761-70f2-42dc-8b71-3ff168066f28'} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.756455 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] The token cache is being invalidate because project bd503c52c4b24dae9a0ad09f30208a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 09:07:16.756754 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.757421 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG keystone.notifications [None req-5c259761-70f2-42dc-8b71-3ff168066f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 09:07:16.758948 dv-cinder-850321-5-smb devstack@keystone.service[81541]: [pid: 81541|app: 0|req: 1450/2902] 10.222.0.42 () {58 vars in 1233 bytes} [Wed Aug 24 09:07:16 2022] DELETE /identity/v3/projects/bd503c52c4b24dae9a0ad09f30208a8e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 09:07:26.427717 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:07:26.753085 dv-cinder-850321-5-smb devstack@keystone.service[81541]: DEBUG dbcounter [-] [81541] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:09:36.488426 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Authenticating user token {{(pid=81542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 09:09:36.489835 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:09:36.556703 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aac67-d183-422a-9c24-2546c37c7dac admin admin] Validating token access rules against request {{(pid=81542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 09:09:36.616578 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66b4c2-d180-46dc-b037-0eb0a8ed8e02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28ecb57b15c24e4488eb3c78413194f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'afe9de59ee464958ade8c90b4de6929a', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 09:09:36.617190 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66b4c2-d180-46dc-b037-0eb0a8ed8e02 service placement] REQUEST_METHOD: `GET` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 09:09:36.617475 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66b4c2-d180-46dc-b037-0eb0a8ed8e02 service placement] SCRIPT_NAME: `/identity` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 09:09:36.617748 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66b4c2-d180-46dc-b037-0eb0a8ed8e02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 09:09:36.619489 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.fernet_utils [None req-cc66b4c2-d180-46dc-b037-0eb0a8ed8e02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 09:09:36.630524 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66b4c2-d180-46dc-b037-0eb0a8ed8e02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 09:09:36.632093 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66b4c2-d180-46dc-b037-0eb0a8ed8e02 service placement] RBAC: Authorization granted {{(pid=81542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 09:09:36.642397 dv-cinder-850321-5-smb devstack@keystone.service[81542]: [pid: 81542|app: 0|req: 1453/2903] 10.222.0.42 () {60 vars in 1365 bytes} [Wed Aug 24 09:09:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 09:09:46.638129 dv-cinder-850321-5-smb devstack@keystone.service[81542]: DEBUG dbcounter [-] [81542] Writing DB stats keystone:SELECT=58 {{(pid=81542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}